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ABSTRACT 

This study concerns a demonstration enrichment 
program for intervening into the ways of thinking, learning, and 
behaving displayed by urban ghetto children in Harlem public schools. 
The study focuses on the implications of ongoing research by the 
Institute for Developmental Studies (IDS) for the further 
understanding of the independent behavior of children in and out of 
the classroom, and also on the effectiveness of the IDS classroom 
procedures, in the evaluation procedure, behavioral rather than 
standardized test criteria were used, both in the classroom and in a 
’’transfer" situation; classroom observation followed by rating of 
third-grade children from the demonstration program on 
"systematically developed, reliable, behavioral checklists" was used. 
The findings of the study indicated that the expectations of 
reliability and usability of the classroom behavior checklist were 
realized. However, it was found that independence of behavior in 
children — at least in the age group of the subjects tested — does not 
"carry over" into situations outside the classroom. Further, the 
nature of the task, situation, and the requirement placed before the 
child were found to seem to be of key significance. [Not available in 
hard copy due to marginal legibility of original document.] (RJ) 
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Chapter 1 

Background and Hypotheses of the 

i 

Current Investigation 

V 

General Background and Need for this Investigation 

In 1962, in an effort to reverse the corrosive process of academic 
retardation that plagues the disadvantaged child, the Institute for 
Developmental Studies began to translate its prior and current research 
findings into action in the form of a demonstration program in Harlem 
public schools, carried out in cooperation with the New York City Board 
of Education with the support of the Ford Foundation, Office of Economic 

j 

Opportunity, and other public and private funding agencies. (See 
Powledge ^/1967/ for a description of the Institute’s program.) 

Our enrichment program stemmed from the assumption that heavy stress 
on cognitive areas — specifically on verbal and language skills — would be 
the most effective means for intervening into the ways of thinking, learn- 
ing, and behaving (with the consequent limitations in achievement) displayed 
by the urban, ghetto children with whom we were working. For many years, we 
have employed a variety of instruments for assessing the effectiveness of 
our work in Harlem. These have included such instruments as: The Stanford- 

Binet Intelligence Scale, the Peabody Picture Vocabulary Test, the Columbia 
Mental Maturity Scale, Reading Prognosis Test, Lorge -Thorndike Intelligence 
Test, Gates Reading Test, Illinois Test of Psycholinguistic Ability, the 
Wechsler Intelligence Scale for Children, and the Institute’s specially 
developed Early Childhood Inventories. 

As an ongoing evaluative process, the Institute continually explores 
various behaviors as measured by the foregoing instruments, but also, in 
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a more general way, attempts to describe certain qualitative aspects of 
our program based on such sources of information as supervisors’ and 
teachers’ reports, ’’feedback” from parents and community observers, and 
principals’ comments and observations. In general, findings have been 
most heartening, since many positive results have emerged. 

Of significance and relevance to the purposes of this proposal, we 
should note that through. the years, supervisors, teachers, visitors, 
and community personnel have been impressed with certain ’’noncurricular” 
aspects of our ihterventive impact on the children in Institute classes. 

Expressions such as ’’greater independence,” - ’’more maturity,” ’’quieter and 

* 

less motoric” have been applied to them, frequently in the context of 
comparisons to children in other ghetto classrooms. And indeed, it would 
seem that many of the teaching techniques and classroom procedures 
employed by the Institute are not only directed toward the teaching of 
content but also toward introducing changes in behavior, such as the 
developing of independence ^j.n the learner. Thus, such classroom techniques 
as the introduction of individualized activities, quiet work-time, small 
group involvements, decision-making activities, individual use of tape- 
recorder, etc. have not only been employed to teach, for example, reading, 
listening, and language skills, but also to aid in the development of 
certain behavioral and . interpersonal skills. Indeed, the classroom is 
physically engineered to encourage the children to move about, obtain 
and then replace materials, and to operate equipment. We have been trying 
to give them opportunitites -to see that they can have substantial control 
over their environments. 

We were soon confronted with the questions of whether the Institute’s 
enrichment classes have indeed encouraged the kinds of behaviors various 
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observers have described. Even more important, does the behavior displayed 

* 

in the demonstration classrooms TT carry over” — transfer — to situations out- 
side of the classroom? 

Some Theoretical and Methodological Issues . It is important to note that 
several issues are relevant to our research. The first concerns the need 

explorations of this sample for purposes of assessment. 

0-) The i.e ed for behavioral criteria . It' bears repeating, but not 
necessarily elaboration (since so much as already been written about this 
issue see Eells, et al. ^1951/'; Guidelines for Testing Minority Group 
Children, Deutsch, et al. /196M/; Minuchin, et al. ,£1967 7; and Zubin, Eron, 
Sc Schumer 2/L965/) , that standardized tests, especially of the papsr-and 
pencil variety (but also even individual tests, say, of general ability) 9 
are not culture-free. They penalize large numbers of children from 
disadvantaged social environments because they require skills in test- 
taking, listening, following instructions, and sitting still, not to 
mention general verbal and language ability which are simply not "built- 
into the repertoire of children who otherwise may be intelligent, alert, 
and well able to learn. Further, from a more theoretical view, and in 
connection with what is emerging as methodologically desirable, we are 
learning that behavior is the most valid and reliable criterion for 
diverse measurements in personality, psychotherapeutic change, diagnosis 3 

prediction of success in various job situations, etc., even for nondisadvan- 
taged populations. 

We note, then, that our orie.ntation rested on the general assumption 
that employing aspects of behavior to predict behavior and to shed light 
on behavior appeared to be the most methodologically sound approach. 



(2) TJie need for employing a “transfer model” and problems in inter- 

4 

preting results . Any individual working in the area of test development, 
with its criterion problems as well as ultimate predictive validity problems , 

v 

knows (whether or not he gets around to this) that eventually his general i- 

zations or recommendations must suffer the test of cross-validation or the 

test of applicability to new samples or new situations. 

In the same vein, we felt that it was not enough to demonstrate that our 

classes produced certain types of behavior; we wished to demonstrate that 

this change carried over to other situations. A child "programed" by certain 

types of classroom environments may behave in accordance with that programing 

* > 

provided no. change in milieu takes place. Crucial for study, not just in the 

| 

proposed research, but also with regard to teaching techniques in general, 
was the extremely important question of transfer and generalization to other 
situations. Indeed, an implicit assumption of interventive education as 
well as conventional education is that the child generalizes what he learns 
(or what we think he has learned) to other classrooms, to the community, 
and to his daily life. 

Thus, the long history in academic and laboratory circles that the 
transfer of training paradigm has enjoyed seemed to us more than, a wasted 
effort in experimental minutiae. For this history offered a model for ex- 
perimental ' exploration of a' vital issue. Are we indeed making an impact 
which has meaning outside the teacher-classroom situation? 

It should be stressed, however, that this issue is not that clear nor 
that easily resolved; definitive answers may not be readily available to the 
researcher. For intrinsic to the problem of transfer is the question of the 
role of situational variables. Perhaps, after all, independent behavioi^ at 
least in this age group, is partially rooted in situational and stimulus- 



roilisu variables, and that only a careful examination of the surrounding 
situation (above and beyond individual personality variables) will yield 
accurate predictors of behavior. One implication of this issue is that 
failure to find transfer effects may not at all mean that we have failed 
to train for independence. The behavioral sessions and their tasks are, 
after all, rather dissimilar from the classroom situation, and the behavior 
elicited in them. Independence may not be, in other words, a personality 
trait (as noted, at least at this age level) that is ,T carried” within the 
individual from situation to situation. 

Positive findings in the current study, then, will suggest transfer 
effects, back of positive findings, however, must perforce be less defini- 
tively interpreted. 

Objectives and Hypotheses 

As noted in the original proposal for this investigation, one of the 
major purposes of the current research lies in its implications for the 
further understanding of the independent behavior of children in and out of 
the classroom; an equally important purpose is relevant to assessing the 
effectiveness of certain Institute classroom procedures. Specifically with 
regard to the latter point, the basic problem under consideration is whether 
noncurricular aspects of behavior transfer to new situations. 

It was hoped that the present investigation would also shed light on 
whether independence is correlated with length of exposure to the IDS en- 
richment classes, as well as whether there are individual variations in the 
extent to which independent behavior transfers to unfamiliar situations. 

We also hoped to ascertain whether non-institute control Ss from the same 
schools could be differentiated from the Institute experimental Ss in regard 
to the extent to which the behaviors related to the dimensions in which we 
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are interested would emerge in the transfer situation. 

Our objectives, then, related to assessing the Institute's effectiveness 

in encouraging independent, autonomous behavior in . its enrichment classrooms, 

on the general (commonly accepted) assumption that not only is such behavior 
* 

development ally and socially TI normal Tt on the age levels with which we were 
working, but also indicative of the kinds of cognitive and emotional changes 
that underly productive, achieving future behavior — in and out of the class- 
room. To evaluate our success along these lines, we used behavioral rather 
than standardized test criteria, both in the classroom and in a n transfer ,T 
situation, to explore whether the behavior that appeared in the classroom 
did, indeed, emerge outside of that ’’programed** situation. Moreover, we 

i 

wished to explore whether, in the transfer situation, relatively greater 
frequencies of independent behavior would be found among our demonstration 
pupils than among an equivalent group of disadvantaged controls. 

The study, in effect, was geared to evaluate our curriculum effective- 
ness and goals in terms other than those related to achievement, content 
skills, and the like. Of significance in the design of this study is the 
meaningful issue of transfer of learned behavior to situations outside of the 
classroom with the expectation that some children in our experimental sample 
would not display independent behavior— a reflection of the fact that an 
interventive program cannot, and does not have the same impact on all members 

of its target population, and that there are subgroups among the disadvantaged 
population itself. 

The general model we employed to achieve the foregoing goals was to 
observe (in the classroom) and then rate third-grade children from the demon- 
stration program on systematically developed, reliable, behavioral checklists. 

^Equivalent control classes are in classroom situations that are conducted 
conventionally, with the typical classroom arrangements of seated-pupils- 
facing— a~teacher— at-a— desk layout and with movement, free choicG of materials, 
etc., not encouraged. Such J3s could not, perforce, be rated and compared to 
the demonstration Ss. 



The latter instrument-development procedure proved to be a major aspect of 
the year T s work. Two trained, independent experimenters observed the experi- 
mental Ss in the classrooms over a period of time, employing the behavioral 

checklist. Two new raters then anonymously rated the material based on 
* 

behavioral observations of the children along a four-point discontinuous 
scale: independent (productive); pseudoindependent; nonindependent; and 

can T t rate, cSon T t know. (The "pseudoindependent" classification derives from 
the basic fact that behavior that subsumes motility, detachment, noninvolve- 
ment, inattentiveness, and the like — might be rated as independent, but that 
such behaviors could hardly reflect the construct in which we were interested.) 
Following a behavioral, non-classroom observed transfer situation which allowed 
independent behavior to emerge (and the development of transfer tasks also 
proved to be a major research activity) , observers who did not observe in 
the classroom rated random small groups of demonstration and equivalent con- 
trol subjects on the same four-point discontinuous scale. No rater had any 
prior knowledge about any JS. 

Our hypotheses and expectations based on the above procedures (the latter 
are described in complete detail in the next chapter) follow: 

(1) After operationally defining so-called independent, mature (age- 
related) behavior, we hoped to be able to distinguish the behavioral variables 
assuciated with this attribute from "independent” behavior which is not pro- 
ductive or useful; and these behaviors, in turn, from nonindependent behavior. 
We expected a range of such behaviors in the enrichment classrooms with a 
relatively larger number of ."independent" ratings than the other types of 
ratings; and, we also expected that F3 "filler" J3s (replacements due to 
attrition who entered our program in the third grade) , since they had 
virtually no years of exposure to the enrichment program, would be rated 
relatively less frequently as "independent" than the other experimental Ss. 
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(2) Having thus identified behavioral subgroups along this dimension 

in the demonstration classes, we expected that in a non-classroom, behavioral 
transfer situation, those rated as "independent” would tend to receive the 
same rating by another team of observers who had no prior knoxvledge about 
the preceding ratings; the same expectations were held for the Ss rated as 
"pseudoindependent" and "noni.ndependent." In other words, we expected our 
prior classification along this trichotomy to be related .to classifications 
of the same S!s as observed and rated in a new situation. "Filler” status 
would of course be considered in this analysis. 

(3) We expected that control Ss would receive fewer ratings of Tt in- 
dependent"- in the transfer situation, and relatively more ratings of 7T de- 
pendent" than the demonstration Ss, again, with "filler" status of the 
experimental Ss considered. 

(4) Needless to say, underlying the past year T s research activities 
was the basic expectation that we would develop a reliable, usable classroom 
checklist, which we could later employ in more theoretical explorations of 
independence along construct validity lines. 

(5) A subsidiary expectation concerned the notion that on the basis of 
checklist designations, trained "global" raters (without seeing the Ss) would 
rate, some of them as "pseudoindependent," and that the latter is a meaningful 
category in this regard. 

• Finally, we should add that we were quite interested in exploring the 
role of situational variables in determining . behavior, on an assumption that 
independence is not, after all, "carried within" the individual from situation 
to situation regardless of the nature of that situation. 
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Chapter 2 

Sample and Methodology 

The general modeL for the currently described research \\?as briefly 
' presented in the preceeding chapter. The design included: (a) the develop- 

ment of a reliable behavioral classroom checklist for independent, pseudo- 
independent, and dependent behavior; (hi) the formal phase of classroom 
observations (over time) using the checklist (involving two observers) ; 

(c) the "global" rating of these checklists by two different independent 
raters: (d) the development of quantitative, continuous scores based on 

i 

checklist observations; * (e) the development of behavioral tasks for the 
"transfer" sessions which would yield an opportunity for reliable ratings 
to be made; and (f) the "running" of experimental and control Ss in these 
transfer sessions with independent observations and ratings made by pairs of 
observer-raters. Note, the first (classroom) phase of the research utilized 
children (the experimental Ss) from the Instituted classes. Non-Institute 
classes were not observed for independent behavior, since. In terms of their 
physical layout, they did not offer an opportunity for relevant ratable be- 
haviors to emerge; The behavioral sessions, on the other hand, were based 
on small groups of randomly assigned experimental and control children. The 
Institute children had, it should be noted, varying degrees of exposure to 
our enrichment classes. 

The current chapter describes: (a) the subject population with which 

we worked in this investigation; (b) development and* description of the 
classroom behavior checklist; (c) development and description of the be- 
havioral '• ,-ks for the transfer sessions; and (d) description of the global 
rating employed in the various phases of our study. Chapter 3 presents 
information concerning the development of other scores, the checklist re- 
vision, various reliability explorations we conducted, and data analyses 
and findings for various parts of the study. 



Sample 



Exper i mental Ss~~Phase I (Classr oom O bservations) 

• The larger population from which subjects for this study were drawn 
consisted of third graders (1968-1969) in the Instituted demonstration 
classes in Public Schools 68, 79, 90 , and 175 in Harlem. 

Because the currently described study was of only one year’s duration* 
wa could not work with third graders from all four of the foregoing schools. 
Had we done so* about 150 subjects would have been involved when equivalent 
controls were added. Since this was not a feasible sample size, two schools 
were selected on the basis of their yielding the largest numbers of third- 
grade children who have had at least two years of exposure to the Institute’s 
enrichment program. ' 

In the classroom observation phase of the research* 19 children were 

observed . at Public School 90 and 21 children at Public School 175. Of 'the 

40 children included in this sample* 28 children had at least two years of 

exposure to the Institute’s program (12 at Public School 90* and 16 at 

Public School 175). The distribution of this sample by school, age, sex, 

2 

and length of time in the program is shown in Table 1. 

Table 1 shows that average age for each school is virtually' the same, 
and that only minor age differences for the various types of subjects within 
each of the schools are found. Most Sis* as of September, 1968, were eight 
years and a few months old; a few Ss were just under eight years of age; 
one S> was seven years and four months, and another* seven years and five 
months old. Sex distribution is uneven in this population* with almost two- 
thirds of the total sample consisting of boys. 

Since years of exposure to the IDS program is a variable in which we 

~2 ~ • • 

The fii\st progress report (December* 1968) described a sample of 41 children 

(see Table 1 in Progress Report #1). One _S at Public School 90* however, 

moved out of that school district before the classroom observations could 

be completed. 
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are interested, and since the development of independence is age-related, 
it is interesting to sec_ whether or not wide differences in mean ages are 
found between subjects classified as to "filler” status. Table 2, which 
presents mean age for various classifications of Ss (with both schools 
combined), indicates that as of September, 1968, average age for each 

classification is approximately 8 years and a few months, with wide differ- 
ences among groups not found. 

Experimental a nd Control Ss-- Phase II (Transfer Sessi on s) 

The J3s described above were observed along with control Ss in the 
behavioral transfer sessions which will be described shortly. The actual 

experimental sample was reduced by one because a female S from Public School 

i 

90 was not available when the behavioral transfer sessions were run.. She 
was an F3 S, thus reducing that group from 9 to 8 Ss and the total experi- 
mental sample in the transfer sessions from 40 to 39. Table 3 presents the 

# 

distribution of this sample by school, age, sex, and length of time in the 
program, and Table 4 presents mean age for these classifications with both 
schools combined. When Table 4 is compared to Table 2, it can be seen that 
only minor changes were introduced by the elimination of one S. 

i 

Control _Ss ware drawn from the third-grade classes of Public Schools ■ 

90 and 175. No selective factor was introduced: controls were taken from 

all the non-institute third-grade classes in these schools. Table 5 presents 
mean age and sex breakdown for these subjects. Note, although 39 control 
J3s were actually "run" in the behavioral sessions, only 37 were regarded as 
control Ss due to sampling; errors. 

The control Ss come from the same SES,. school, and community backgrounds 
as the experimental Ss. Mean ages are almost identical with those of the 
experimental Ss, it should be noted. 
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The Classroom Behavior Checklist 

This section describes the development of the Classroom Behavior 
Checklist for Dependents Independent, and Pseudoindependent behavior, as 
well as the checklist itself as we actually used it in initial phases of 
the current investigation. 

Working Definitions of Behavioral Categories 

During the early periods of pilot work, when we were considering items 
for checklist inclusion, we clarified our thinking concerning what we meant 
by the various behavioral categories. It should be stressed that this 
clarification took place within the context of constant feedback from our 
research .team as to .their observational experiences with groups of child- 
ren using some of the earlier items. It was during this early period, for 
example, that we confirmed our expectation that our prior classification, 
pseudoindependent, had some behavioral meaning. (We saw, however, that 
this term could be ambiguously interpreted, since it seemingly did not 
imply a behavioral referent other than that which could be regarded as a 
residual or derivative from tne independent behavior category.) Raters, 
teachers, supervisors, and others on our professional staff all seemed to 
agree that certain behaviors as observed in the classroom fell neither into 
an independent nor a dependent category, but yet were still classifiable 
that is, such behaviors were easily identifiable and were not of a Tf don T t 
know" nature. Indeed, this third category (but not middle category, since 
a continuum is not implied) subsumed behaviors which our observers sug- 
gested were rather salient and recognizable, for their characteristics were 
overt and often possessed an attention-getting quality . 

From sources in the literature, our own experiences in the schools, 
and feedback from our research team, then, the following working definitions 
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of the behavioral categories emerged: 



(1) Independent behavior is oriented .toward productive (constructive) 
goals, is age-related and is self-initiated. The. independent child- manifests 
behavior which is both self-reliant and self-assertive. He is considered 
independent of others to the extent that he attempts to satisfy his needs in 
a manner which is not entirely a function of the way others behave toward 
him. A child is considered independent when he conducts his problem-solving 
activities without seeking unnecessary help from others, and is able to carry 
on his activities without continuous need for reassurance, affection, or ap- 
proval. Independence also includes behavior which is self-asserti.ve , such as 
striving to master tasks. Independent children characteristically show rel- 
atively good motor control, that' is, their motility is appropriate to the 
situation: they are neither overly constricted nor excessively motoric. 

( 2 ) Pseudoindependent behavior can be. described as nonproductive, 
nondependent behavior; characterized by the seeking of attention through a- 
social or antisocial activities, the maintenance of physical and psychological 
distance from peers or teachers (leaders), high motility, and inconsistency 

in the pursuit of goals . Children so designated are likely to interfere with 
the activities of other children, refuse to participate in group activities, 
and be destructive of work materials and equipment. Such children often do 
not accept help or follow instructions, even though their own efforts are 
clearly not successful. They also tend to show random sequences of behavior 
with unrelated activities begun and discarded before completion. 

(3) Dependent behavior is determined by the presence of specific 
characteristics, not merely by the absence of characteristics specific to 
independence. Responses that are characterized as dependent, are often those 
that seem directed toward obtaining social reinforcement. Such behavior 
includes many different kinds of activity, such as: persistent3_y seeking 
help (whether necessary or unnecessary) ; affection-seeking; and bids for 



attention-, reassurance, approval, succorance, and guidance. Dependent 
behavior is also manifested in passivity and lack of spontaneity. 

Development of the Classroom Ob servation Checklist 

Early in September, 1968, various classroom behavior scales and re- 
ports in the literature were examined for the construction of a large pool 
of possible items. Some of these sources were: Seller (195S) ; Cervenka (1967) 
' Davidson and Greenberg (1967); Finney (1961) ; Gewirtz (1956); and Hartup 
(1963) . As noted, this procedure was also combined with group discussions 
and feedback concerning refinement and clarification of what was meant by 
each of the categories (independent, dependent, and pseudoindependent) . 

Later that month, each item was discussed from the point of view of a minimal 
standard — face validity. At this point, it became clear that items reflect- 
ing motor activities (such as hyperactivity in the classroom) and distract! - 
bilrty should be included in the pool of items; it also became clear that 
there were many seemingly distinct items which were, in fact, reflecting 
identical behavioral elements. Gradually, more items reflecting the child’s 
interaction with other children were developed. We also began to consider, 
at this time, the mechanics of the actual observations. 

.Pilot-testing was begun in October, 1968, using second-grade children 
in Public Schools 175, 90, and 79 in Harlem. Third-grade children at the 
Friends Seminary were also observed. The original checklist was revised 
three times on the basis of pilot observations. During this preliminary 
period, the observers worked with and evaluated the feasibility of using 
various observation units, (that is, size of units or groups of children who 
were observed), durations of observation periods, and other classroom 
observation procedures. 

In the light of certain difficulties encountered in observing the 
children in small groups, or in too short segments of time (the behaviors 
in which we were interested required some continuity of observation -over- 
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time), as well as becciuse of other mechanical considerations (for example, 
the unwieldiness of checking the behavior of several children at a time on 
large checklists) , the procedure finally adopted in November was: two observers 
. independently observed each child in a single classroom for five-minute peri- 
ods, in sessions lasting up to two hours. The particular hours selected were 
to be scheduled well in advance and took into consideration the teacher v s 
daily schedule of classroom activities. (We learned, for example, that ob- 
serving children cooxing, or having juice, or dancing in a group did not yield 
the kind of variation in behavior which we were seeking.) A brief "narrative” 

i 

was wxutten by the observer as he was watching the particular child. At the 
end of each day of observation, each observer independently reviewed his own 
narratives, and the relevant behavior was checked on the checklist (for each 
child) along a four— point scale — frequently, moderately often, rarely, and 
never. A fifth category, no opportunity to observe, was also included. 

The checklist at this point had been revised to include nine items 
in each of the three . behavioral categories (see next section). By about 
the middle of November, the checklist was tested, once more (Public School 
175) by having each observer observe and rate each child for a five-minute 
period. The two observers showed high reliability in their observations. 

The formal data collection period began in November, 1968, and ran 
through most of January, 1969, in Public Schools 175 and 90. Subjects were 
independently observed by two observers in their normal classroom settings . 

The total number of sessions and observations per child ranged from four- 
teen to twenty-one , with a median of twenty. No difficulties in either 
using the checklist or in the actual mechanics of classroom observations 
arose during the testing period. 

The schedule for both observers was based on random selection of 
days of the week and random time -cluster sampling at each school (modified 
only to balance the number of observations at each school) . In addition, 
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separate randomized lists of subjects were prepared for each observer for 
each day of observation. 

Departures from strict randomization of the ordering of subjects were 
necessitated, however, by the absence of some of the children for various 
reasons (e.g., some were not in school on a particular day, some were sent 
on errands, some were taken out to rehearse their parts in a forthcoming 
play, and sometimes the group activity so structured the situation that 
valid observations could not be made, as in story-telling time) . 

Whenever possible, a child who was not available at the scheduled 
time was observed later on a randomly determined basis. If a child was 
absent morp than four times, the observation period was extended so that 
the ratings were finally based on a minimum of 16 (with a maximum of 20) 
observations on each child for each observer. 

At the end of each day, all identifying data were removed from the 
narratives after they were typed. At the end of the several -we el observa- 
tion period, each observer independently summarized his daily checklist on 
one master list for each child, with frequency counts summarized for each 
category for the four-point scale: frequently, moderately, often, rarely, 
and never (as well as no opportunity to observe) . 

Note, narratives allowed the opportunity for singular or unusual events 
to be recorded events that were not anticipated, or even though they occurred 
.but once, were thought to bear some significance to what we were after. Nar- 
ratives also could provide, we thought, an opportunity to qualify a behavior 
tally on the checklist for example, a child who was considered unusually 
hyperac <-ive was later taken home by his mother because the nurse reported 
that he had a high temperature. This procedure was introduced in the light 
of the possibility that some unique aspect of behavior or some special cir- 
cumstance could arise which was not or could not be anticipated by the be- 
havior checklist, despite our careful pilot-testing in many classroom situ- 

o 
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ations. Such narratives, we expected, would allow the final raters to take 
into consideration a qualifying, explanatory, or modifying circumstance which 
might alter the picture obtained only from fi^equency counts based on the 
checklist. In actuality our classroom observers have noted that only in 
rare instances did such narratives "clarify" the checklist information, end 
they were of little or no help when the final global ratings were done. 

Further analysis of the narratives was therefore not' undertaken . 

The Classroom Observation Checklist Items 

Appendix A presents the behavior checklist as employed by two inde- 
pendent observers of all the children in the same classroom sit’ . tion (at 
different times during at least a two-hour period at each school) on different 

i 

t 

days over a period of almost two months. The sequence of items is a random 
one. Below are the checklist items (with examples of actual behavior) re- 
grouped into categories according to what we think they are reflecting, as 

judged by construct considerations, as well as empirical considerations during 
pilot phases of our exploration. 

Independence Items — 9 

(4) Volunteers contributions to class discussions and projects — 
e.g., offers information without being called upon. 

(5) Helps, sympathizes, shows consideration of others, is thought- 
ful, offers praise, guidance, assurance - -e. g. , helps other with work when 
appropriate, lends or shat'es materials freely. 

(6) Sits quietly and attentively when task requires--e.g. , remains 
undistracted by irrelevant activities . 

(9) Utilizes available free time constructively — e.g., initiates pro- 
ductive activity when there is no ongoing class activity. 

(11) Withstands interference while engaged in individual activities, 
as in doing difficult assignment, puzzle, painting, etc. — e.g., does not 
abandon task when interrupted . 

ERIC 
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(14) Takes appropriate initiative in problem-solving situations - 
e.g., asks questions for information which seem to be prompted by general 
curiosity rather than bids for attention; seeks needed help; asks questions 
m order to obtain further information or clarification for task at hand.. 

(20) Tries to figure out things for himself before calling on teacher 

(leader) or other children for help— e.g., tries to overcome obstacles in 
the environment. 

(21) Enters readily into new situations; is venturesome, inquisitive, 
etc., when appropriate to ongoing activities— e.g. , is eager to begin new 

. and different activities. 

(25) . Attempts to resolve difficulties that arise between himself 

i 

and other .children without appealing to teacher (leader) —e.g. , does not 

initially seek adult intervention to solve difficulties between himself 
and peers . 

Dependence Items — 9 

(1) Withdraws in the face of difficulty— e.g. , abandons goal when 
• presented with an obstacle. 

(12) Imitates others rather than initiating own activities e.g., 

changes own behavior to conform to the influence of other children. 

(13) Gets upset when called upon in class; appears fearful, tense, 
timid— e.g., requires repeated urging before making a verbal response. 

(15) Seeks to be near others— e.g., follows teacher, assistant, 
leader j classmates about the room. 

(17) Requires close assistance or direction in order to work at a 
task e.g., easily distracted; must have teacher or assistant T s help to 
remain attentive to task. 

(12) Lets other children impose on him or boss him around— e.g., 
does not stand up for his rights; yields his place in line, relinquishes 
> turn at play, etc.; allows others to exploit him. 

o 
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(23) Seeks constant recognition and/or approval— e.g. , tries to get 
teacher T s or assistant’s attention as frequently as can. 

(26) Approaches new tasks timidly and without confidence , shrinks 

from trying new things— e.g. , requires strong encouragement before partic- 
ipating in activities. 

(27) Tends to choose habitual and familiar activities. 

P seudoindependence' Items — 9 

(2) Is inattentive, is easily distracted by things going on around 
him e.g. 5 engpges in random class -unrelated activity (wanders ab out, day- 
dreams when should be working on own) ; talks to visitors about irrelevant 
matters when he/she should be engaged in a task; daydreams; attention wan- 
ders from task at hand;: is not prepared to answer when called upon in clas§. 

(3) Uses materials and equipment in a rough or destructive manner — 
e.g., destroys books, crayons, games etc. 

(7) Brags, shows off, displays exaggerated opinion of own abilities. 

(8) Seeks attention, i.e., in a manner that seems designed for 

* 

active notice rather than stemming from a need for help— e.g., is inappro- 
priately aggressive in seeking the attention of adults. 

(10) Interferes with the work of others — e.g. ,• imposes on other 
children and bosses them around; inappropriately insists on being admitted 
to a small peer group; destroys or takes away the work or materials of 
other children. 

(16) Does not follow directions— e.g. , works dr plays by self 
despite teacher’s request that all children engage in group activity. 

(18) Seeks to do things differently from others , even when own 
method is not effective— e .g. , pet'sists at tasks which are clearly im- ' 
possible. 

(22) Does not pursue task to completion— e.g. , 



leaves task at hand 



for another or to wander about the room. 

(2M) Speaks out of turn: interrupts others; takes others 7 turn, etc. 
— e.g., refuses to wait his turn. 

• The Behavioral Transfer Sessions 

We had originally planned to eliminate from the second phase of the 
study any children for whom unambiguous ratings of Independent, Dependent, 
or Pseudoindependent could not be made. Since the two independent raters 
had not completed their ratings of the Ss (on the basis of data collected ' 
.in the classroom observations) and the Z-score checklist designations (see 
next chapter) also were not completed by the time scheduled for running the 
transfer sessions, the entire sample was included in the second (transfer) 
phase of the study. In the final analysis of data, however, all children' 
for whom it was not possible to make an unambiguous rating were excluded. 

Transfer session leaders and observers were trained during pilot- 
testing of the tasks on second-grade children at Public Schools 79 and 175. 
The leaders were two experienced psychological testers (one male and one 
female) . Each leader conducted approximately one-half of the experimental 
sessions at each of the two schools from which the control and experimental 
samples were drawn (Public Schools 90 and 175) . 

Four experienced observers were also trained, two to serve regularly, 
and two to substitute on occasions when it was necessary to schedule 
sessions simultaneously at both schools. In the latter case, one of the 
regular observers was always paired with one of the substitute observers. 

The two session leaders and the four observers were staff members 
who were not involved in the collection of data in the first phase of the 
study; each, of course, did not know the composition of the groups, that is, 
the experimental or control status of the subjects. 

. The leaders and the observers were rotated between the schools, and 
the children were randomly selected for each session at each school. 



As noted, there were 39 experimental Ss. Since 39 Ss were also run 
as controls, the total number of children in the experimental sessions 
was 78. There were, in all, 15 sessions: seven sessions at Public' Schoo 

90 (involving 36 children) ; and 8 sessions at Public Scnool 175 (involving 
4-2 children) . Table 6 presents the distribution of experimental and 
control Ss by sex and school for the transfer sessions. 3 

Parental permission was obtained for working with the control 
children in this study. The principals of the schools were extremely help- 
ful in guiding us in this procedure to insure the greatest degree of co- 
operation from parents and teachers of the non-institute children. 

Subjects were run in groups of four or six, the composition of each 

} 

group being consistently one— half experimental and one— half control 
children. Other than this criterion, the children were conpletely random- 
ized, so that the mixture of independent, pseudo independent, and dependent 
Institute children varied from group to group. This procedure was adopted 
to eliminate the possible experimenter bias that might emerge if the 
observers knew that the composition of the group was always partially 
structured by the distribution of the experimental Ss. 

The original, plan had been to match experimental and control .Ss by 
sex. This, however, proved not tc be feasible because of difficulties 
encountered in obtaining parental permission for use of control Ss. 

Ultima Lely, to avoid causing excessive hardshiji to school personnel, it 

was necessary to drop the requirement for matching control to experimental 
Ss by sex. 

P_evelopment of the Transfer Tasks 

# % 

U dev, -^ed considerable staff discussion during the early part of 
the year to the exploration of various possibilities for tasks, games, 



3 See Note, Table 5. 
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puzzles, and tests to be used in the transfer situation which would allow 
a variation of behavior to emerge. As a matter of fact, members of our re- 
search team made several trips to various commercial dealers' of toys and 
■ playthings in New York City to obtain ideas for techniques, puzzles, games, 

etc. which might be appropriate for our needs. Specifically, Creative 

* * 

, Pla y thin S s and Childcraft were visited as well as several department stores. 
The selection of such tasks was by ho means a simple procedure. The 
tasks had -to be difficult enough, with children of unequal intellectual 
capacities, to allow choices for each child in terms of seeking help, ask- 
ing .appropriate questions, wo-fking diligently on his own, seeking help even 
though the solution is reachable, etc. Tasks that were too easy would not 
aUow dependent behavior to emerge. Tasks that were too difficult would 
cause all children to seek help or to give up. Further, whether the Ss 
would be observed working together in small -groups or alone as they solved 
the tasks had not yet been resolved. 

By the end of October? we had considered, but had neither accepted 

nor rejected, various tasks and situations including, among many others, 
the following: 

(1) An Asch-type task (Asch, 1956) which would allow conformity- 
dependency behavior to emerge. In this situation, Ss would have the oppor- 
tunity of producing written or verbal responses, so that objective measures 
of conformity-dependency would be available. 

(2) Various standardized or semistandardized tests and clinical 

\ 

instruments such as the Block Design test, the Goldstein-Sheerer tests, 
the Vigotsky test, the Stencil Design test of the Arthur Point Scale, etc. 

(3) Various experimental techniques, such as the level of 'aspiration 
procedure so popular in the ’forties, in' whic ih a. child could be induced to 
conform to, or could withstand, influence to alter his level of aspiration 



in accordance with the examiner T s instructions (or quasi -information 
about the subject T s performance of the performance of peer groups). 

(4) A large jigsaw puzzle of a map of a moderately unfamiliar area, 
possibly Canada. With this task, 'the Ss could be instructed to put the 
pieces together as best they could, on their own. They would be informed, 
however, that there was a large map of Canada behind a screen which they 
could consult, if necessary. Persistence and the lack of consultation 
would be the criteria for best (independent) performance. 

The extensive pilot-testing of the tasks to be used in the transfer 
sessions was based on many of the same second-grade children who xvere 
observed during the -preliminary work with the behavior checklist, ' thereby 
giving us the advantage of knowing their characteristic classroom behavior. 

The tasks for the transfer sessions that were finally developed to 
elicit behavior relevant to the three categories in v’hich we were interest- 
ed are described in the next section. One of the major criteria for 
their selection was the range or variety of behaviors they seemed to elicit, 
including interaction with peers as well as authority figure ;. In the 
pilot phases, we also evaluated various tasks from the point of view of 
ease of task-administration. Finally, during this preliminary period, we 
assessed the potential of various tasks to elicit rater-agreement as to 
the Ss T behavior. 

We devised some unstructured as well as some structured situations to 
permit different types of behavior to emerge. The structured situations 
were generally based on the Asch model (1956) , modified to avoid the need 
for a confederate or ,r stooge Tt role. This was necessary since it was not 
feasible to use the children as confederates. The use of an adult con- 
federate would have confounded the situation; Crandall (1967), for example, 
reported that earlier research had indicated that compliance to adult 



pressures and values was found among high- achieving children of this age ' 
group. 

The behavioral tasks, which we devised for peer groups, of four or 
six Ss, are described below, as noted. It will be seen that tasks (1), (3), 
and (4) are relatively structured, while tasks (2)' and (5) are relatively 
uns Lructured . The latter tasks provide opportunities for moderately wide 
variations in behavior, while the former do so to a. lesser extent. 

In the actual administration of the experimental sessions, tasks were 
presented in rotation so chat the order in which they appeared was balanced 

i 

across all groups. Each session lasted for approximately three-quarters 
of an hour. , 

The behavioral sessions were conducted in vacant classrooms in 
Public Schools 90 and 175. ^esks and chairs were arranged in the front of 
the room so that the subjects could be seated with empty desks between eaeh 
of them. The raters sat at either' end of a large desk placed at the side 
of the room. Here they could easily observe the children without being in 
their direct visual field. The materials used for the various tasks were 
also kept at this desk. ■ Another small desk was situated in front of the 
room, directly under the blackboard. This desk and the chalk tray were 
used for displaying materials to the children. 

v 

Prior arrangements had been made with the teachers for taking the 
children from their classrooms. While the leader went to pick up the 
children, the raters prepared the room and task materials. This procedure 

insured that the raters remained unaware of which children were experimental 
Sjs and which were control Ss. * 

During the sessions, the group leader stood at the front of the room, 
attempting to create as informal an atmosphere as was possible x^hile still 
maintaining the subjects ? attention. As the sessions progressed, the two 
observer-raters recorded frequencies of various behaviors as well as 



comments on worksheets which had been developed and polished during the 
pilot phases. These observations, special comments, responses, . and tallies 
were used by the observers in their ratings of each S^. Immediately after each 
session, then, the -observers independently rated each S_ on the following scale 

Rater : IDS Code No. 

Check only one : 

I — Independent Highly 

P — Pseudoindependent Highly 

D — Dependent - • Highly 

X — Can r t rate 

Degree of confidence in rating — check one : 

3 high 2 medium 1 low 



It should be noted that all tasks were employed in qualitative 
fashion by the raters who. In effect, were rating the Ss globally. 
Administration and Description of the Tasks 

After all the subjects were in the room, E said: 

GOOD MORNING (AFTERNOON). I* M MR.' (MISS) 

NOW I : D LIKE EACH OF YOU TO INTRODUCE YOURSELF. 

E called on each !3 to give his name and recorded each name for 

identification purposes. E then said: 

YOU f, RE GOING TO BE WORKING ON DIFFERENT KINDS OF GAMES AND 
THINGS. WHILE I"M GETTING THE THINGS READY, YOU MAY COME ■ - 
AND GET A BOOK TO READ, IF YOU WISH. YOU MAY TAKE IT BACK 
TO YOUR SEAT. 

4 

E pointed to a large stack of books . This introduction helped to 
ease the Ss into the situation and also occupied them while E was preparing 



Moderately 

Moderately 

Moderately 



the materials. 



a) Peer influence — bean guessing;' . 



Jars tnat were approximately in diameter * ranging in height from 
about 2" to 7" and filled with beans were presented in ascending order of 
size. There were six such jars available, but either four or six were 



employed depending on the size of the group (i.e., either four or six Ss) 

ALL RIGHT. WE WILL PUT THE BOOKS ASIDE NOW, AND TRY S- 
GUESSING GAMES . HERE IS A JAR FILLED WITH BEANS. I T M uulNG 
TO CALL ON EACH OF YOU, IN TURN, TO GUESS HOW MANY BEANS 
THERE ARE IN THE JAR. NOW, DON T T ANSWER UNTIL YOU T RE CALLED 

0N# — (CHILD #1) : HOW MANY BEANS DO YOU THINK 

THERE ARE IN THIS JAR? 



1L then called on each child in order. 

, ' ‘ * 
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VERf GOOD. NOW, HERE IS ANOTHER' JAR FILLED WITH BEANS 
LET T S SEE HOW WELL YOU CAN GUESS ON THIS ONE. REMEMBER 
DON'T TALK UNTIL I CALL ON YOU. THIS TIME ’ 

(CHILD#2) WILL START. 



THINK THERE ARE IN THIS JAR? 



HOW MANY BEANS DO YOU 



This procedure was repeated with the jars of different sizes until 
each of the children had responded in all order positions. 

This behavioral situation, an Asch-type structured task, indicated 
the extent to which S’s guesses were influenced by those preceding him; or 
conversely, the extent to which his judgments remained independent of 
guesses made by other children in the group. 

S pontaneo us beha vior, self-reliance, peer-influence --geometric 

puzzles . 1 * 

For this task, a seven-piece, colored plastic puzzle was employed. 

A great variety of geometric designs can be constructed with this puzzle 
by arranging the pieces in various ways . Although the puzzles appear 
simple, they are in fact quite difficult to solve. The two designs 
selected for our task are shown in outline form in Figures 1 and 3, while 



'♦ihis is a Kohner Educational Puzzle, called VOODOO, manufactured hv 
Kohner Bios.', Inc., P.0. 294, East Paterson, N.J. 
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th-eir corresponding solutions appear in Figures 2 and M . All figures are 

scaled to actual size. The pieces of each puzzle distributed to the Ss 

were numbered with a marker to correspond, to the numbers on the solution 

diagrams. E introduced this task by saying: 

OKAY, NOW WE T RE GOING TO DO SOMETHING ELSE. I T M GOING TO 
GIVE EACH OF YOU A PUZZLE, AND I WANT YOU TO MAKE A DESIGN. 

TAKE THE PIECES OUT OF THE ENVELOPE. BUT DON T T START UNTIL 
I EXPLAIN EVERYTHING. 

While talking, E distributed the envelopes, placed the outline of 

the first figure on a stand in front of the Ss, and the solution face down 

on the desk. Pointing to' the displayed outline, E said: 

NOW, TO MAKE THIS FIGURE CORRECTLY, YOU MUST USE ALL 
, SEVEN PIECES. TRY TO WORK THE PUZZLE AS FAST AS YOU CAN. 

i * 

E briefly flashed the solution: 

I’M GOING TO PUT THE PICTURE THAT SHOWS HOW TO WORK 
THE PUZZLE HERE. I WANT YOU TO TRY YOUR BEST TO DO 
THE PUZZLE YOURSELF— BUT, IF YOU REALLY THINK YOU CAN’T 
DO IT, YOU MAY COME UP AND LOOK AT THE PICTURE. OKAY, 

START NOW; AND WORK AS FAST AS YOU CAN. TRY TO DO 
THE VERY BEST YOU CAN . 

E withdrew to the back of the room for several minutes , and then 
came forward to ask: 

WOULD ANYONE LIKE SOME HELP WITH THE PUZZLE? ' 

To maintain the children’s interest and give them a sense of closure, 

E made sure that everyone had succeeded in solving puzzle (A) before the 

second design (B) was introduced. E then said:' 

NOW SCRAMBLE ALL THE PIECES OF THE PUZZLE AND WE WILL 
TRY TO MAKE ANOTHER ONE. 

The same procedure was followed for the second design (B) . 

This task provided such information as: persistence before looking at 

j 

the solution; whether the child copied from his neighbor in attempting to 
solve the puzzle; whether the child really worked at the solution or simply 
did not try; whether the child imitated another child by going up to look at 
the solution; and whether the child resisted or readily accepted the offer 



for adult assistance. 



(3) Peer influence-circle , square, star.; dot guessing . 

Six sets of six cards each were prepared: 

Set (A) was constructed of black posterboards 11” x 14 TT . Each -card 
contained approximately 150 stick-on circles of various bright colors. For 
easy identification, the cards were labeled with the letters F, HL J. L, N. 
and R. Figure 5 is a partial reproduction of . a card in this series. 

Set (B) consisted of 11" x 14” blue posterboards each containing stick - 
on circles of a single color: either green, orange, pink, red, tan, or 
yellow. Figure 6 is a partial reproduction of the green card. 

Set (C) also consisted of 11 :T x 1M M posterboards, three with black 
and three with grey backgrounds . Each card was pasted with squares of a 
single color, either blue, green, orange, purple, red, or yellow. Figure 
7 shows part of a card from this series. 

Set (D) was constructed of gummed stars of various colors on 9” x 11 ,T 
posterboards. The backgrounds of these cards were red, green, or blue and 
there were two cards of each. These cards were labeled G, L, 0, S, X, and 
Y. See Figure 8 for an example of this set. 

.Set (E) contained 8 -inch square drawings which were used in another 
(unrelated) research investigation with children.^ These consisted of a 
heavily dotted background containing a more finely dotted figure of an 
object: clock, cup, gun, hand, key, and safety pin. The cup stimulus is 
shown in Figure 9. 

Set (F) , also developed previously, was .similar to Set (E) except 
that the background consisted of a grid instead of dots. The common objects 
pictured in this series were: boat, horse, pail* pan, rabbit, and scissors 
(see Figure 10, the horse stimulus) . 

5 C. Deutsch and F. Schumer. Brain-damaged children: a modality -oriented 
exploration of performa nce. New York: 13 runner/Maz e 1 , Inc., in press. 
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(A) ALL RIGHT. NOW WE T LL TRY ANOTHER GUESSING GAME. 

I T M GOING TO PUT THESE CARDS HERE, .AND I WANT EACH OF YOU 
TO GUESS WHICH ONE HAS THE MOST CIRCLES. ' DON T T 
ANSWER UNTIL I CALL ON YOU. WHAT I WANT YOU TO DO IS 
TO GUESS TOUCH CARD HAS THE MOST CIRCLES- -CARD F H J 
L, N, OR R. 



E called on each child in a predetermined order. He then introduced 
the five (or three) 'additional sets of stimuli, calling on the children in a 
predetermined order so that each child responded in all order positions. 

(All six sets were used when a full group of six children was present. 

When the group contained four Ss, only the first four sets of cards were 
introduced.) 



j ( B ) OKAY, NOW WE T LL TRY ANOTHER' GUESSING GAME, WITH 
! S0ME DIFFERENT CARDS. EACH OF THESE CARDS HAS CIRCLES 
OF A DIFFERENT COLOR. BE SURE NOT TO ANSWER UNTIL I CALL 
ON YOU. TOUCH ONE HAS THE MOST CIRCLES: GREEN, ORANGE, 

PINK, RED, TAN, OR YELLOW? THIS TIME 
WILL START. . 



All other sets were introduced with instructions similar. to those for 

(B) , except that the Ss had to guess about squares, or stars, or dots. 

This is also an Asch-type task, giving indications of conformity to 
peer influence. 



(4) Self-reliance — counting animals . • 

For this task, 8 x 11” booklets with . drawings of animals and other 
common objects were constructed. Each page of the booklet contained nine 
pictures. The total number of animals pictured in each of the six booklets 
ranged from 48 to 53. Thus, each S/would arrive at a different number* if 
he counted the animals correctly. Figure 11 is a page from one of the 
booklets. E said: 



NOW WE*LL DO SOMETHING ELSE. AFTER I FINISH EXPLAINING 
YOU CAN START, BUT DON T T START UNTIL I TELL YOU WHAT I*D 
LIKE YOU TO DO. - 



E distributed a booklet to each child, face down. 



E continued: 



. I WANT YOU TO GO THROUGH THE BOOKLET AND COUNT ALL OF THE 
PICTURES OF ANIMALS THAT YOU SEE THERE. IF YOU FINISH 
COUNTING BEFORE EVERYONE FINISHES, JUST LOOK UP, BUT DON*T 
SAY ANYTHING. SIT QUIETLY AND WAIT UNTIL EVERYONE FINISHES, 
SO THAT YOU WON T T INTERFERE WITH THEIR COUNTING.* AFTER YOU 
HAVE ALL COUNTED THE ANIMALS, I r LL ASK YOU TO TELL ME HOW 
MANY YOU COUNTED. 



After all the children had finished counting, E called on them, one 



at a time, for their estimates. ]B then continued: 

NOW I WOULD LIKE TO BE SURE THAT YOU COUNTED CORRECTLY, 

SO IF YOU DON ? T TRUST YOUR OWN COUNTING, YOU MAY ASK 
SOMEONE ELSE TO CHECK IT OVER FOR YOU. 

This task is another variation of the Asch-type situation, intended 

i 

to elicit measures of self-reliance. 

(5) Authority and/or peer influence — picture construction . ' 

The materials for this task consisted of sheets of colored geometric 
n stick-ons TT and 5 ff x 8” index cards. A simple doll-like figure using a 
few of the stick-on shapes given to the children had been constructed for 
demonstration purposes (see Figure 12) . 

c 

Displaying the- preconstructed design, E said: 

NOW I T M GOING TO GIVE EACH OF YOU A -CARD AND SOME OF 
THESE COLORED SHAPES, AND YOU CAN EACH MAKE A PICTURE. 

JUST *T0 SHOW YOU HOW THESE SHAPES CAN BE USED, HERE IS A 
PICTURE SOMEONE-: ELSE DID. YOU CAN MAKE ANY PICTURE 
YOU LIKE. WHEN YOU T RE FINISHED, TURN THE. CARD OVER AND 
PUT YOUR NAME ON IT. I WANT TO KEEP THE CARDS FOR AWHILE, 

BUT THEN I J LL GIVE THEM TO YOUR TEACHER SO THAT SHE CAN 
RETURN THEM TO YOU. 

This task was designed to indicate S/s conformity to authority and 
peer influence. The Ss could either duplicate the E T s picture, copy from 
their neighbors, or construct their own pictures. The pictures were re- 
turned to the Ss after the* year T s work was completed to avoid contamination 
of responses to this task. 



The next chapter presents the findings based on the research methods 
described in the current chapter. 



Chapter 3 
Findings 



The material in the present chapter is presented, roughly speaking, in 
two sections— reliability findings and the development of certain scores; 
and results of data analyses pertaining to the testing of hypotheses. 6 

I 



Reli ability Measures and the Developm ent of Scores 
This section consists of the following: (a) checklist — reliability 

of observations for paired observers for each item; (b) checklist — item-, 
total correlations (within each category) ; (c) checklist — the development 

of quantitative, continuous scores yielding subject classification procedures 

(based on- Z-scores) ; (d) reliability of "global” ratings based on checklist 

two independent raters; (e) reliability of ratings in the transfer sessions- 

two independent raters; and (f) checklist- -the relationship of Z-score desig- 
nations and "global” ratings. 

C hecklist — Re l i ability of Observ at ions for Paired Observers for Each Item 
As will be recalled, and as can be seen in Appendix A, the Classroom 
Behavior Checklist comprised items which fell into the three categories of 
independence, pseudoindependence, or dependence. Observations of these be- 
haviors for each day of observation for each child (over a period of time) 

were tallied for the different frequency points: frequently , moderately 

often , rarely , and never . 

To calculate the reliability of observations per item, for each S 
a frequency count was made of the number of tallies ' per item for each of 
the foregoing frequency points for each of the observation sessions, with 



g " 

See Edwards (1954) for a 
we employed. 



description of the various statistical 



procedures 



data for each observer treated separately. The can’t rate uoint was P v. 

♦ 1 1 ' " 1 1 1 1 1 

eluded in this procedure. Totals of these counts 'for each child per item 
across all of the observation sessions were then calculated,, These compu- 
tations yielded the total number of "ratable” time- sampling observations made 
for each child for all sessions for each observer. To obtain a score for 
each child, weights were assigned: fr equently - 3; moderately often - 2: 

f ? an(i Hgver 0. (Higher scores for any item reflect "more" of the 
particular behavior observed, i.e., greater independence, greater pseudo- 
independence, or greater dependence.) These weights were then multiplied 
by the number of observations for the scale point, yielding a total score 
for that scale point. These scores were then totaled across scale points. 
Totals were then divided by the number of ratable observations to yield a 
mean score for the child, thereby eliminating irrelevant variance resulting 
from unequal numbers of observations. These item total scores were finally 
transformed by adding a constant (+1) to each, to eliminate zero scores and ' " 
products in determining inter- observer reliability. 

The total scores for each item were paired for each independent observer, 
and Pearson correlation coefficients were then computed for these paired scores 
The coefficients thus obtained indicate the amount of agreement between ob- 
servers. These correlation coefficients are reported in Table 1 . 

An examination of Table 7 discloses a wide range in magnitude of the 
obtained coefficients--with the pseudcindependence c ategory containing the 
largest number of items with higher reliabilities. Because reports by the 
classroom observers indicated extreme difficulty in working with some of 
the items (some relevant behaviors simply did not occur* , we decided to 
systematically explore the possibility that the items with lower reliability 
coefficients were those which were simply not ratable or for which there 
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were nu opportunities to observe relevant behavior, while the items with 
higher coefficients were those which related to behaviors which occurred 
with greater frequencies. Accordingly, we arbitrarily established co- 1 
efficient cut-offs of .70 and above and .30 and below, and tallied fre- 
quencies of the no opportunity t o observe category for each item thus 
designated as possessing high or low reliability. The results, presented 
in Table 8, consistently indicate that our expectations were correct. Co- 
efficients of .70 and above were indeed found for items that were associated 
with consistently observable behavior, while coefficients of .30 and below 

were found for items that were associated with behavior that simply did not 

* 

emerge and therefore could not be rated. Interestingly, items with co- 
efficients of .30 and below (n=5) were subsumed in the independence and 
depend ence categories, but not in the pseudo independence category — the 
latter apparently reflecting behaviors that are salient, observable, ratable, 
and moderately reliable in terms of observer agreement. 

The next step was to eliminate from the pool of checklist items those 
with low inter-rater reliability. We chose a cut-off of coefficients of .30 
or less for this procedure. Accordingly, all items not reaching the criterion 
of a greater than .30 coefficient of reliability were eliminated from the 
checklist. By this criterion, eliminated at this stage were the fallowing 
five checklist items (note — no checklist item from the pseudoindependence 
category had to be eliminated on the basis of this criterion) ; 

Independence Item l4: takes appropriate initiative in problem- 

•solving situations (r=.18) 

* v 

Item 21: enters readily into new situations ; is 

■venturesome, inquisitive, etc., when 
appropriate to ongoing activities (r=.02) 

o 
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‘ Item 12: imitates others rather than initiating 

own activities (r=.12) 

Item 13: gets upset when called upon in class; 

appears fearful, tense, timid (r=.ll) 

Item -26: approaches new tasks timidly and without 

confidence; shrinks- from trying new things 
(r=. 15) 

Check list-— Item— Total Correlations (Wit hin Each Cate gory) 

Scores for retained items were next correlated with total category 
scores, using the Pearson correlation method. (Nunnally /T9677 has re- 
commended that if multipoint items are employed, the regular Pearson pro- 
duct-moment correlation method is appropriate.) 

Table 9 presents the resulting series of item-total correlation co- 
efficients between a particular item and the total for the particular category 
in which it is subsumed. From this table, it can be seen that several of 
the items (none in the pseudoindependence category) fail to reach the criterion 

of significance of £ is .05 or less for the particular coefficient. These 
items are: 

I ndependence Item 4: volunteers contributions to class dis- 

cussions and projects 

Dependence Item 15: seeks to be near others 

Item 27: tends to choose habitual and familiar 
activities 

The remaining items achieve high levels of item-total correlation. 

These items comprise a final pool which constitutes the new, revised check-, 
list. This new checklist, then, presented as Appendix B, contains only 



o 
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those items which met the criteria of sufficiently high inter- rater re- 
liability and high item-total correlation coefficients to warrant their 
continued inclusion in the final pool. The revised checklist (consisting 
now of six items in the independence , scale , four items in the dependenc e 
scale, and nine /the original grou£7 items in the ps eudoindependence scale d 
is being used in a continuation of the current study. to explore correlates 
and construct validity of the behaviors which we are able to measure re- 
liably. This includes explorations of such variables as creativity, socio- 

i 

metric status, and self-concept. 

Quantitative, Co ntinuous Scores for Checklist — Z-Score Classification 

It became apparent as we were working with the checklist material that 
it would be desirable to devise scoring procedures wherein quantitative con- 
tinuous scores (within each category) could be calculated for each observed 
jS. This would permit us, for current as well as future purposes, to be 
more flexible with regard to using various data-analysis procedures, for 
example, in ranking subjects within each of the categories, or in working 
with extreme subjects (determined quantitatively, rather than nominally) 
within a particular category. 

After considering several possibilities, the procedure selected for 
the "scoring system" for the checklist was based on computing Z-scores 
(separately for each school) for each j3 for each item within the checklist 
categories (indepe ndence , dependence , pseudoindependence^ based on the scor- 
ing system outlined in detail in an earlier section of this chapter. Note, 
Z-scores were based only on items retained after the foregoing reliability 
and item-analysis procedures were completed. Further, since two scores for 
each item per J3 were available (there were two observers) , the procedure for 
obtaining a single Z-score involved computing the mean of the two observer T s 



item score as described in the section noted above. 



Within each school Z- scores were calculated par item for each Si. Mean 
Z- sc ores were next Computed for items within each category for each S3 1 
Table 10 presents the three mean Z- scores for each S3, along with his rank 
in each category. Table 11 presents the Ss T ranks in all three categories 
with Ss ordered according to rank on the independence mean Z- sc ores from 
high to low. 

A "rule-of-thumb" was then devised for designating subjects for purposes 
of data analysis on the basis of their ranks on the three mean Z-scores as 
presented in Table ll. Subjects with ranks of 1 through 20 on the independence 
items (above median rank) are to be regarded as u independents,” provided that 
their ranks on both of the other categories fall below their respective medians, 
that is, fall between 21 and 40. Subjects with ranks in the independence 
category of 21 through 40 are to be regarded as TT nonindependents ,, Tf provided 
that their ranks for one or the other or both of the two remaining categories, 
depe n dence or pse udoindependenc e fall at or above the median of 20 (i.e., 1-20). 
On the basis of these criteria, the designations of the Ss as presented in 
Table 11 resulted in classifying 13 Ss as "independent," 18 as "nonindepend- 
ent," and 9 as "n.ixed" types. 



The data in Table 10 are presented separately according to school. Were 
there only chance differences in ranks due to schools, then mean of ranks 
for designation within each school would be 20 or as close to 20 as is possible. 
In actual fact, these means do indicate this to be the case. That is, as ex- 
pected, there seem to be little or no school differences in assigned rank 



within each designation. 


Specifically, these means 


are: 


School 


Designation 


Mean of Ranks 


P.S: 90 


Independence 

Dependence 


20.50 

20.59 


(if 2 2) 


Pseudoinde •* endence 


20.86 


P.S. 175 


Independence 


20.50 




Dependence 


20.33 


(ris) 
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• Pseudoindependence 

• 


20.06 



Reliability of Tt Global TT Ratings Based on Checklist- -Two Independent Raters 
Simultaneously with, and independently of, the statistical determi- 



nation of observer and item reliabilities, overall ratings for each child 
were made by two additional, independent raters (the Principal and Co- 
Principal Investigators) , using the scale presented below. These raters 
based their ratings on two summary checklist sheets for each child (one 
.for each independent classroom observer) which contained total frequencies 
for each scale point for each item on the behavior checklist. As noted, it 
was not possible to use the "narratives” (comments by the observers on the 
child* s classroom behavior with regard to anything salient that might have 

j 

occurred) in this process, since they did not contain sufficiently complete 
or consistent information from child to child to warrant their use. 



Rater 



IDS Code No. 



Check one only : 

I — I ndependent Highly 

P — Pseudoindependent . v Highly 

D — Dependent Highly 

X — Can T t rate 

Degree of confidence in rating — check one : 
3 h igh 2 medium 



Moderately 

Moderately^ 

Moderately 



1 low 



After these ratings were completed, inter-rater reliability was 
determined on the basis of Cohen’s recommended use of weighted kappa (1968) 
as a coefficient of agreement for nominal scales. This measure not only 



corrects for chance agreement, but also allows for differential weighting 
of disagreements according to the degree of gravity of such disagreements. 

It is therefore possible to weight scale-point disagreements (i.e., highly, 
moderately) less - heavily than categorical disagreements (i.e., independent, 
pseudoindependent, dependent) . Table 12 contains the matrix of the weights 
we employed for this procedure. These weights range from 0 to 4. The larger 
the weight, the greater the disagreement; 0 indicates no disagreement, and 
4 indicates maximum disagreement. 

Table 13 shows the distribution of the global ratings made by the 
independent raters. -These data yielded a reliability coefficient of .76 
when weighted kappa was computed, taking into account scale points as well 
as category. This results in jz = 5.43 (p^.0002, two-tailed). (Unweighted 
kappa, based on categorical designation only, yielded a reliability coeffi- 
cient of .873, resulting in jz=4.48 /p< .0002, two-tailecj7.) It can therefore 
be concluded that the raters showed excellent agreement in designating the 
j3s into the three relevant classifications on the basis of the summary check- 
list data. 

From Table 13, it can be seen that global ratings based on checklist 
summary information tend to yield little disagreement. It should also be 
noted that both raters were able to execute the ratings quickly and with 
considerable confidence. By and large, even ratings made with low confi- 
dence tended to agree with each othe* . The raters ware under the general 
impression that the degree of confidence each rater tended to assign to her 
ratings was a question of personal T, style’ r — for there seemed to be differ- 
ences between the raters in the frequency with which tT low confidence” was 
checked.’ 



I 



Reliability of Ratings — Transfer Sessions 

Chapter 2 describes the manner in which ratings of behavior in the 
transfer sessions were made. Inter-rater agreement (for the scale just 
presented) was indexed by means of Cohen T s weighted kappa (1968). As al- 
ready noted, this canputac n not only corrects for chance agreement, but 
also allows for differential weighting of disagreements according to. the 
degree of gravity of such disagreements (see Table 12) . 

Table 14 shows the frequency distribution of the ratings by paired 
observers of the transfer sessions. These data yielded a reliability 
coefficient (kappa) of .257, which, in terms of the -normal curve deviate, 

results in jjz=2. 18 (p {.03, two-tailed). This coefficient is based on the 

| 

46 cases remaining after the elimination of ratings in which observers ex- 

9 

pressed low confidence (Nj=24) and those designated "can’t rate ” (N=6). 

Table 15 summarizes the number of agreements and disagreements within 
and across categories. As can be seen, most of the disagreements were in 
regard to the independence — dependence ratings, and among these, most were 
in regard to the moderately independent vs. moderately dependent choices. 

It is thus seen that observers’ agreement in the transfer sessions, 
although moderately good, does not fall on the same level as that obtained 
for a different set of raters who made judgments on the basis of the check- 
list. It is highly probable that the kinds of operations involved in making 
such ratings differ considerably in each situation, with judgments in the 
transfer situations more liable to various types of error than those based 



Inclusion of "low confidence" ratings in the commutation of weighted kappa 
resulted in a rather low reliability estimate prompting us to exclude those 
cases from the analysis described. When these cases are included (total N~70 
for there were 6 "can’t rate" designations), the findings were: weighted”" 

kappa was .182, which in terms of the normal curve deviate, results in z=1.89 
(p< .06, two-tailed). . . 
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on checklist information. 

» 

Relati o nship of Z-score Designations and "Global" Ratings 
When ratings based on Qualitative examination of the checklist were 
completed,, they were compared to the designations of the experimental Ss 
based on their Z-score ranks for each of rhe categories on the checklist. 
Note, for this analysis, those Z-score classifications which were labeled 
"mixed” and those global ratings which represented disagreements between 
the raters or which involved a "can’t rate" designation were notused. 

This analysis then, was based on a group of 29 Ss. 

Table 16 presents the contingency classification of designations derived 
from each of the above sources. A chi-square analysis as to whether these 
two methods of classifying the Ss are associated yielded a probability level 
of <.025 and a contingency coefficient of .486. It is thus concluded that 
there is a positive association, established with some degree of confidence, 
between the method of rating behavior globally (on the basis of qualitative 
examination of the checklist material) and that of objectively classifying 
behavior on the basis of the Ss’ Z-scores. 

XI 

Data Analyses Pertaining to the Testing of Hypotheses 
The current section describes findings pertaining to the following 
analyses: (a) global checklist ratings vs. ratings (experimental subjects 

only) in the transfer situation; (b) Z-score checklist designations vs. 
ratings in the transfer situation; and (c) distribution of experimental Ss 
according to "filler" status vs. global checklist ratings, Z-score checklist 
designations, and behavioral (transfer session) ratings. The foregoing is 
Part A of this section,, and relates to explorations involving the experimental 



j>s only. Part B of the current section pertains to experimental vs. control 
differences in terms of the ratings of independence or dependence made in 
the behavioral sessions. Analyses of results were made for schools separately 
and combined as well as for groups with and without JSs for whom ratings with 
"low confidence” were made. 

A. Experimental Ss Only 

Global Checklist Ratings vs. Ratings in the Transfer Situation 

The next two sections present data analyses for only those J3s (experi- 
mental Ss) observed in the classrooms. These sections are addressed to the 
question regarding "transfer" — that is, whether designations based on class- 
room behavior are in any way associated with designations based on behavior 
in the nonclassroom situation. The first of these analyses is concerned with 
whether the global ratings based on the checklist are associated with status 
as rated in a later transfer (behavioral) situation. The findings, as 
presented in Table 17, indicate a lack of association between these two 
methods of classifying the Ss . 

Z-Score Checklist Designations vs. Ratings in the Transfer Situation 

Table 18 presents data pertaining to the relationship between objective 
Z-score classifications based on the checklist and ratings made subsequently 
in a nonclassroom behavioral situation. These findings also indicate a lack 
of association between these two methods of classifying the Ss. 

The foregoing analyses (sec Tables 17 and 18) do indeed suggest that 
insofar as the current research design in concerned, behavior as classified 
in the classroom is not similarly classified in subsequent nonclassroom 
behavioral situations. Thus, it would be reasonable to suggest that such 
behavior does not "transfer." The situations are so different from each 



other, however, that one can raise a reasonable doubt as to whether transfer 
effects were actually being measured by the behavioral sessions. The next 
chapter briefly touches on this issue again. 

"Filler" Status and Three Different F.atings of Experimental Ss 

As will be recalled (see Table 1) , the experimental children were 
classified according to "filler" status, depending on the number of years 
of membership in the Institute classes. One of the hypotheses of this study 
pertains to the possibility that length of exposure to our demonstration 
program would be associated with status (independence, pseudoindependence, 
or dependence) as determined through checklist ratings, Z-score classifi- 
cations, and behavioral session ratings. (See Table 19 for these frequency 
distributions.) Table 20 presents results of analyses pertaining to these 
expectations. All analyses yielded nonsignificant results, it should be 
noted. 

Specifically, all Ss were allocated to one of five groups defined by 
the year the child entered the program. For example, if an entered the 
Institute’s program in 1964 at the prekindergarten level, he received four 
full years of exposure to an enriched classroom atmosphere and curriculum; 
if he entered the program in 1968 (an F3 subject) , however, he virtually had 
no exposure to the Institute’s program when the current study was initiated. 
In this sense, then, F3 subjects are similar to control subjects, at least 
in the beginning of the fall term of 1968. To explore the association 
between various measures and status of subjects in terms of length of ex- 
posure to the Institute’s program, we grouped all Ss with "filler" classifi- 
cation of: the full four years of exposure, through three, two, and one 

% * 

year of exposure (E, FK, FI, and F2 Ss) and examined their ratings in com- 
parison to the F3 group. That is, Ss receiving one year or more of our 



program were compared to Ss who had entered the program the year of our 
investigation in terms of distributions of ratings and Z-score designations. 
As presented in Tables 19 and 20, data analyses indicate that there is no 
association between TT filler tT status and global checklist ratings, Z-score 
classifications, or behavioral session ratings. 

B. Experimental vs. Control Ss (Behavioral Sessions’) 

Ratings of Ss in the behavioral sessions were examined in terms of 

< 4 r ir " 
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experimental vs. control status of the subjects. Table 21 presents the 
results of chi-square analyses for subjects in both schools combined with 
(a) >' low confidence” ratings included and (b) Tt low confidence” ratings 

eliminated. Table 21 also presents results for both schools held separately 
with ratings of n low confidence” included with these analyses because of 
the small j^s involved. All analyses were based on four-fold tables (one 
degree of freedom) with Yates- corrected values of chi-square, and all 
comparisons involving the experimental group were based only on those 
Ss with one or more years of exposure to the Institute program. 

For all comparisons, the N of the experimental sample was reduced 
from 39 to 37, because 2 Ss from Public School 175 were randomly eliminated 
to equate the Ns of the experimental and control samples. (These Ss, as it 
turned out, were also rater-disagreement Ss,) In comparisons (1) and (2), 

9 F3 Ss and 13 rater-disagreement Ss were eliminated 'from the experimental 
group; in addition, 5 ,r low confidence” rating Ss were eliminated from the 
experimental group in comparison (2) . 

There are 37 control Ss in comparisons (1) and (2) of which 18 Ss 
were eliminated because they represented rater-disagreements. In addition, 

4 ”low conf idence” control S5s were eliminated in comparison (2) . 

In comparison (3) there were 19 experimental and 19 control Ss 



(Public School 175) . The 9 j5s who were rater-disagreements and 3 F3 Ss 
were eliminated from the experimental group, leaving a total of 7 experi- 
mental Ss. From the control group, 11 rater-disagreements were eliminated, 

♦ 

leaving a total of 8 control Ss, 

In comparison (4-) , there were 18 experimental and 18 control Ss 
(Public School 90). Of the 18 experimental Ss, 4 rater-disagreements and 
6 F3 Ss were eliminated leaving a total of 8 Ss. Of the 18 control Ss, 7 
rater-disagreements were eliminated, leaving a total of 11 Sis. 

All findings reported in Table 21 are nonsignificant— that is, there 



is no apparent association between experimental and control subject status 
and the ratings assigned to them based on behavior in the transfer sessions. 
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Chapter 4 

Summary and Conclusions; Abstract of Continuation Research 

K 

This chapter will briefly recapitulate the major findings and relate 
these to the expectations and hypotheses described in Chapter 1. It might 
be noted that since the currently described research has continued into the 
present, and is still ongoing, major conclusions and discussion will be 
deferred until the present year T s work is completed. This year’s work 
(1969-1970) involves cross-validation of the checklist with a similar sample, 
development of reliable measures of creativity, self-concept,, and sociometric 
choice, and exploration of the relationship of scores from the latter three 

i 

! 

areas as well as teacher-ratings of independence, to more objective measures 
of independence derived from the checklist. The end of this chapter presents 
a brief abstract of the current continuation research. It should be noted 

that this work is well under way. 

# / 

A basic, overall expectation was that we could develop a reliable, 
usable classroom behavior checklist. This expectation has been met. Inter- 
rater reliability coefficients (see Table 7) were utilized to eliminate items 
of low reliability; in addition, item- total correlations for checklist items 
within each category (see Table 9) were further examined to eliminate additional 
items. The resulting checklist, presented in Appendix B, thus contains only 
those items which met the criteria of sufficiently high inter-rater reliability 
and high item- total correlation coefficients to warrant their continued in- 
clusion in the final form of the checklist. The revised checklist is being 
used in a continuation of the currently described study, as noted, to explore 
correlates and construct validity of independent behavior. 



The preceding chapter described the development of an objective Z- 
score based on checklist findings as well as a systematic TT rule TT for classi- 
fying subjects based on their Z-score profiles. These designations are 
presented in Table 11, and resulted in classifying 13 Ss as "independent," 

18 as "nonindependent; 77 and 9 as "mixed 1 types. (The latter, it should be 
noted, is not synonymous with the "pseudoindependent 77 category.) Global 
raters (who ware not in the classroom) independently rated the Ss on the 
basis of summary checklist data (see Table 13) with an extremely high degree 
of reliability — that is, with little or nc disagreement. 

* 

Table 16 presents data pertaining to the association between global 
ratings and Z-score designations of the Sis. It was concluded that there 
is a positive association, established with some degree of confidence, 
between these checklist methods of categorizing behavior. 

Ratings of observers in the transfer situation (see Table 14) were less 
reliable, it should be noted, than those based on summary checklist data. 
Several possibilities can be offered to "explain 77 the latter finding: (a) 

four different raters (rather than two, as planned) were used in the transfer 
session; (b) ratings in the transfer session were based on one observation 
session, whereas data obtained in the classroom were obtained over many 
sessions of observation; (c) the tasks and behavioral situations we utilized 
were in many ways unique to the observers and to the subjects alike; despite 
training, the raters were perhaps not comfortable in assigning ratings to 
the J3s based on such an unconventional approach; and (d) the nature of 
the behavioral session was such that it might simply not have elicited 
reliably ratable behavior (at least to the same extent as did the class- 
room situation). 
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For the experimental £5s, overall findings indicate that the 
designations based on classroom behavior are not associated with designations 
derived from the transfer situation. Thus, Tables 17 and 18 indicate that in- 
sofar as the current research is concerned, behavior classified in the class- 
room is not "carried over” to nonclassroom behavioral situations. Based on 
classroom data alone, however (see Table 13), experimental subjects were 
judged more frequently by independent raters to be independent than other- 
wise; further, as this table also shows, such raters used the category of 

pseudoindependence even more frequently than dependence, suggesting that the 

* 

pseudoindependent category, as expected, is meaningful in terms of characterizing 
classroom behavior. Also , classroom observers were particularly reliable 
in judging pseudoindependent behavior; and item-total Pearson correlation co- 



efficients in the pseudoindependent category were all significant. 



As presented in Tables 19 and 20, data analyses indicate that there is no 
association between "filler” status and the global checklist ratings, Z-score 
classifications, and behavioral session ratings of the experimental subjects. 
Finally, Table 21 indicates that there is no apparent association between 
experimental and control subject- status and the ratings assigned to them 
based on behavior in the behavioral ses ' *ons. 

Overall, the foregoing findings indicate lack of support for most of 
•the hypotheses and expectations as presented in Chapter 1, with the exception 
of those pertaining to the checklist, and its development arid use. 

Indeed, it does seem that the "transfer" session was an inadequate method 
for measuring "transfer" effects, and that although we are seemingly eli- 
citing independent behavior in the classroom, the experimental Ss, when com- 
pared to experimental F3 "filler" Ss and to the control group Ss, did not ’ 
appear to differ in terms of their assigned ratings with any degree of 
statistical confidence. Some reasons for greater unreliability of the 
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ratings in these situations were presented earlier.. It may also be that 
the significant and crucial variable is the striking differences between 
the classroom situation and the behavioral situation. In some respects, 
the behavioral situation ' resembled the typical control classroom more than 
did the experimental classroom. In this sense. Institute independent child- 
ren might well have not "carried” their independent behavior over into the 
new situation. Conversely, control Ss might have felt freer to show in- 
dependent behavior in a situation which was structured to elicit such be- 
havior more than did their typical classroom situation. 

Although a complete discussion of these points will be presented in the 
1970 Final Report, it should be noted here that the literature presents some 
evidence that dependency may not be a unitary trait but rather is a rubric 
for different behaviors. Thus, a child would be rated differently depending 
on the aspect of dependency measured. Furthermore, some studies indicate 
that the situational aspects in which the dependency is measured are of 

importance. It is likely that this evidence is relevant to the study of 
independence, too. 

In any event, we may be forced to conclude that independence 
does not "carry over" into other situations— at least in this age group- 
regardless of that situation. Further, the nature of the. task, situation, and 
t! *® req uirement placed before the child, seem to be of key significance. 
Questions of construct validity, that is, just what independence is and 
what its correlates are seem to be crucial, at this point of our studies, 
and it is to these issues that our current work is addressed. We are content 
that we have developed a usable instrument for doing so, at least in terms 
of classroom activity. Further, since many "conventional" classrooms 
(kindergarten, for example, or prekindergarten) provide the kind of milieu 
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as to independent, pseudoindependent, and dependent behavior to behavioral 
checklist scores based on observations of these same children. 

(c) To explore the sociometric concomitants of independence, 
pseudoindependence, and dependence. 

(d) To explore the relationship of creativity measures and scores 
to designations of independence, pseudoindependence, and dependence derived 

. ■ r 

from the checklist, and to develop new methods for assessing the creativity 
dimensions in this sample. ' 

(e) To explore the relationship of self-concept (as measured by 
Q-methodology) to designations of independence, pseudoindependence, and * 
dependence derived from the checklist. 

. (f) To examine a number of additional, subsidiary relationships 

that can shed light on the behaviors relevant to the area of our investigation. 

^ • 0 ur sample is composed of all children in as many 1969- 

1970 third-grade Institute demonstration classrooms as are available. Third- 
graders have been chosen as these children have had the longest exposure to 
the Institute program and should, therefore, show the greatest effects of 
this intervention. Within our sample will be "fillers,” those children who 
have been added to the program because of attrition in the initial group. 

The presence of "fillers" will enable us to determine whether behavioral 
change -is a function of the length of time the child has spent in the pro- 
gram. Using the revised behavior checklist, we plan to proceed as follows: 

(a) Early in the school year, two observers will independently 
record, by frequency tallies on the checklist, each child*s behavior during 
five-minute periods over a total of 20 sessions on different days (this 
step is , currently near completion). 

(b) An initial set of sociometric measures will be obtained in 

each classroom by personnel other than those making the behavioral observations 

O 
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as to independent, pseudoindependent, and dependent behavior to behavioral 
checklist scores based on observations of these same children. 

(c) To explore the' sociometric concomitants of independence, 
pseudoindependence, and dependence. 

(d) To explore the relationship of creativity measures and scores 
to designations of independence, pseudoindependence, and dependence derived 

• r 

from the checklist, and to develop new methods for assessing the creativity 
dimensions in this sample. ' 

(e) To explore the relationship of self-concept (as measured by 
Q methodology) to designations of independence, pseudoindependence, and 
dependence derived from the checklist. 

. (f) To examine a number of additional, subsidiary relationships 

that can shed light on the behaviors relevant to the area of our investigation. 

(2) Pr o c e du res . Our sample Is composed of all children in as many 1969- 
1970 third-grade Institute demonstration classrooms as are available. Third- 
graders have been chosen as these children have had the longest exposure to 
the Institute program and should, therefore, show the greatest effects of 
this intervention. Within our sample will be "fillers," those children who 
have been added to the program because of attrition in the initial group. 

The presence of "fillers" will enable us to determine whether behavioral 
change -is a function of the length of time the child has spent in the pro- 
gram. Using the revised behavior checklist, we plan to proceed as follows: 

(a) Early in the school year, two observers will independently 
record, by frequency tallies on the checklist, each child* s behavior during 
five-minute periods over a total of 20 sessions on different days (this 
step is , currently near completion). 

(b) An initial set of sociometric measures will be obtained in 

each classroom by personnel other than those making the behavioral observations. 
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This step has been completed. These same measures will be collected again 
at the end of the year. 

Teachers* ratings of the same children in regard to independence, 

# 

# 

pseudoindependenc^, and dependence will be obtained at both the beginning 
and the end of the school year. The first wave of teachers* ratings has 
been obtained. 

(d) Measures of creativity will be developed and administered to 
the Ss in the sample. 

(e) Q-sort techniques will be developed and administered to all of 
the Ss in the samples simultaneously with step (d) to measure self-concepts 
and self-perceptions. 

At each step along the way, it might be noted, stress will be placed on 
developing reliable and objective instruments and measures. 
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Table 1 
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& 
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Experimental Sample Observed in the Classrooms: Mean Age and Sex for 

Subjects in Public Schools 90 and 175 Classified According 
to Years of Exposure to the Enrichment Program 



Entered IDS Classes 


N 


Sex 


Subject 

Classification 3 


Mean Age, 
(Months) 






Public 


School 90 




Pre-K, 1964-1965 
(4 years of exposure) 


4 


M— 4. 
F— 0 


E 


97.25 


Kindergarten, 1965-1966 
(3 years of exposure) 


2 


M — 1 
F— 1 


FK 


101.00 


First Grade, 1966-1967 
(2 years of exposure) 


6 


M— 3 
F— 3 


FI 


99.50 


Second Grade, 1967-1968 
(1 Year of exposure) 


1 


M— 0 
F— 1 


F2 


> 

103.00 


Third Grade, 1968-1969 
(0 years of exposure) 


6 


M— 3 
F— 3 


F3 


98.17 


Total, P.S. 90 


19 


* M — 11 
F— 8 




98.84 






Public 


School 175 




Pre-K, 1964-1965 
(4 years of exposure) 


14 


M— 8 
F— 6 


E 


98.35 


First Grade, 1966-1967 
(2 years of exposure) 


2 


M — 1 
F— 1 


FI 


99.50 


Second Grade, 1967-1968 
(1 year of exposure) 


2 


M— 2 
F— 0 


F2 


99.00 


Third Grade, 1968-1969 
(0 years of exposure) 


3 


M— 2 
F— 1 


F3 


98.00 


Total, P.S. 175 


21 


M— 13 
F— 8 


m 


98.48 


Total, Schools Combined 


40 


M— 24 
F— 16 


18 Es 

2 FKs 

8 FIs 

3 F2s 

9 F3s 


98.68 


Note — There were no FK subjects in 

a 


Public School 175 in the third grade. 


F categories contain "filler" Ss, 
the years because of attrition. 

"K 


added to the experimental group 


through 
* . 


As of September, 1968. 


Mean age 


for all Ss is just under 8 years 


, 3 months. 



3 

ERIC 



-55- 



Table 2 

Experimental Sample Observed in the Classrooms: Mean Age. for 

Subjects Classified According to Years of Exposure to 

r H 

I the Enrichment Program for Both Schools Combined 



Sub j ect 
Classification 



FK 

FI 

F2 

F3 



Total 



N 

18 

2 

8 

3 

9 

40 



Mean Age a 
(Months) 

98.11 

101.00 

99.50 

100.33 

97.89 

98.68 



As of September, 1968, 



o 
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Table 3 

Behavioral Transfer Sessions — Experimental Subjects: Mean Age and Sex 

for Subjects in Public Schools 90 and 175 Classified 
According to Years of Exposure to the 
Enrichment* Program 



Entered IDS Classes 



N 



Subject 

Sex Classification* 

Public School 90 



Mean Age 
(Months) ° 



Pre-K, 1964-1965 
(4 years of exposure) 


4 


M — 4 
F— 0 


E 


97.25 


t j 

Kindergarten, 1965-1966 
(3 years of exposure) 


2 


M — 1 
F— 1 


FK 


101.00 


First Grade, 1966-1967 
(2 years of exposure) 


6 


M--3 
F— 3 


FI 


' 99.50 


Second Grade, 1967-1968 
(1 year of exposure) 


1 


M— 0 
F— 1 


F2 


103.00 


Third Grade, 1968-1969 
(0 years of exposure) 


5 


M— 3 
F— 2 


F3 


98.40 


Total, P.S. 90 


18 


M— 11 
F— 7 




99.06 


■ 




Public 


School 175 




Pre-K, 1964-1965 
(4 years of exposure) 


14 


M— 8 • 
F--6 


E 


98.35 


First Grade, 1966-1967 
(2 years of exposure) 


2 


M— 1 
F— 1 


FI 


99.50 


Second Grade, 1967-1968 
(1 year of exposure) 


2 


M— 2 
F — 0 


F2 


99.00 


Third Grade, 1968-1969 
(0 years of exposure) 


3 


M— 2 
F — 1 


F3 


98.00 


Total, P.S. 175 


21 


M— 13 
F— 8 




98.48 


Total, Schools Combined 


39 


M— 24 
F— 15 


18 Es 

2 FKs 
8 FIs 

3 F2s 
8 F3s 


98 .'76 



Note — There were no FK subjects in P.S. 175 in the third grade, 
a 

F categories contain "filler” Ss, added to the experimental group through 
the years because of attrition. ; 



b 

is of September, 1968. 



Mean age for all Ss. is just under 8 years 



3 months. 



£ 



t 



Table 4 



f 


Ex t erimental Sample In 


the Behavioral Transfer 


Sessions: Mean A 


£ 


for Subjects Clas 


sified According to Years 


of Exposure to 

* 


it * 

^p 

f 

J' 


r 

i the Enrichment Program for Both Schools Combined 

I 

» 

t 


t 


Sub j ect 




Mean Age 


r 

> 


Classification 


N 


' (Months) 


[ 

i 


E 


18 


98.11 


y„ 


FK 


2 


101.00 


i 


FI 


8 


.99.50 


jt» 

|* 

f 


F2 


3 


100.33 


jj>« 

jt 


F3 


9 


98.25 


i* 

k 

1 


Total 


39 


98.76 



As of September, 1968. 
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Table 5 



Behavioral Transfer Sessions— Control Subjects: Mean Age 

and Sex for Subjects in Public Schools 90 and 175 



N Sex 

Public School 9Q b 

18 j M— 7 

i F— 11 

I 

Public School 175 . 

19 • M —8 

P — 11 



Mean Age 
(Months) a 



* 

99.47 b 



97. 84- 



Total .37 



M— 15 98. 61 b 

F— 22 



Note- -Although 39 £s were run in the transfer sessions, only 37 were 
usable for statistical analysis because of certain errors in sample 
selection. The Ss eliminated were both from Public School 175. To 
compensate for this reduction in sample size, when experimental and 
control differences are explored, two Ss from Public School 175 were randomly 
eliminated from the experimental sample to maintain the initial equality 
in sample size for the two treatment groups. In statistical analyses 

involving only the experimental sample, all 39 experimental Ss were used, 
a "~ 

As of September, 1968. 
b 

Total .n from Public School 90 on which mean age is based is 17 subjects 
because of incomplete school data at this school for one S. Mean age 
for control Ss is therefore based on 36 cases, and is just under 8 years, 

3 months, making control and experimental subjects comparable in this 
regard (see Table 1). • 
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Table 6 



f 



r 



r % 



r 



Session 



1 

2 

3 

4 

5 

6 
7 



Distribution of Subjects by School and 
Sex in the Transfer Sessions 



Experimental 
M F 



Control 
M F 



N 



Public School 90 

2 1 12 

12 12 

12 12 

3 0 12 

11 11 

2 0 11 

11 11 

11 7 7 11 




1 

2 

3 

4 

5 

6 

7 

8 



N 



Public School 175 



3 0 
1 2 
3 0 
2 0 
1 2 
1 2 
1 1 
1 1 

13 8 



1 

1 

1 

2 

1 

3 

0 

1 

10 



Total 24- 15 17 



a 

See Note 4 Table 5. 



2 

2 

2 

0 

2 

0 

2 

1 

11 



22 . 



N 



6 

6 

6 

6 

4 

4 

4 



36 



6 

6 

6 

4 

6 

6 

4 

4 

42 



78 





* 






4 







t 



Table 7 



r 



Item 




( 1 ) 

( 12 ) 

(13) 

(15) 

(17) 

(19) 

(23) 

(26) 

(27) 



( 2 ) 

(3) 

(7) 

( 8 ) 

( 10 ) 

(16) 

(18) 

( 22 ) 

(24) 



Inter-rater Reliability Coefficients 
of Behavior Checklist Items 

Independence 



Product-Moment 
Correlation 
Co ef f ic ients a 



volunteers contributions. to class discussions and projects .31 
helps, sympathizes, shows consideration of others; is 
thoughtful; offers praise, guidance, assurance * .35 

sits quietly and attentively when task requires .71 

utilizes available free time constructively .50 

withstands interference while engaged in individual acti- 
vities, e.g., doing difficult assignment, a puzzle, painting .40 
takes appropriate initiative in problem-solving situations .18 
tries to figure out things for himself before calling on 
teacher (leader) or other children for help .49 

enters readily into new situations; is venturesome, inqui- 
sitive, etc., when appropriate to ongoing activities .02 . 

attempts to resolve difficulties that arise between himself 
and other children without appealing to teacher (leader) .50 



. Dependence' 



withdraws in the face of difficulty .38 

imitates others rather than initiating own activities * 12 

gets upset when called upon in class; appears fearful, 

tense, timid ^1 

seeks to be near others ' • * 64- 

requires close assistance, or direction in order to work 

at a task 7n 



lets other children impose on him or boss him around .45 

seeks constant recognition and/or approval ^69 

approaches new tasks timidly and without confidence; shrinks 
from trying new things 25 

tends to choose habitual and familiar activities .68 



Pseudo indep endenc e 



is inattentive; is easily distracted by things going on 
around him 

uses materials and equipment m a rough or destructive manner 
brags, shows off, displays exaggerated opinion of own 
abilities 

seeks attention, i.e., in a manner that seems designed for 
active notice rather than stemming from a need for°help 
interferes with the- work of others 
does not follow directions 

seeks to do things differently from others even when own 

method is not effective 

does not pursue task to completion 

speaks out of tu.- n; interrupts others; takes other T s 
turn, etc. 



.54 

.58 

,. 58 

.77 

.72 

.60 

.53 

.35 



For all reported coefficients. 



N=40 . 



.95 
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Table 8 

Frequencies of No Opportunity to Observe Category for Behavior 
Checklist Items with Reliability Coefficients of .30 
and Below and .70 and Above 



Coefficients of .30 
and Below 



Independence 

t i 

(14) takes appropriate initiative in problem-solving 
■' situations 

(21) enters readily into new situations; is venturesome, 

inquisitive, etc., when appropriate to ongoing activities 

Dependence 

(12) imitates others rather than initiating own activities 

(13) gets upset when called upon in class; appears fearful, 
tense, timid 

(26) approaches new tasks timidly and without confidence; 
shrinks from trying new things 

Coefficients of .70 
and Above 

Independence 

(6) sits quietly and attentively when task requires 

Dependence 

(17) requires close assistance or direction in order to work 
at a task 

" Pseudo independence 

(8) seeks attention, i.e., in a manner that seems designed 
for active notice rather than stemming from a need for 
help 

(10) interferes with the work of others 

(24-) speaks out of turn; interrupts others; takes other's 
turn , etc . 



Frequency — No 
Opportunity to 
Observe 



466 

633 



618 



586 



601 



33 



83 



36 

35 

124 






i 



Table 9 



Item-Total Pearson Product-Moment 
Coefficients for Checklist Items 3 



Checklist 
Item No. 



r 



Corrected 



Independence 




4 


.544 


.245 


D* S • 


5 


.679 


.530 


.005 


6 


.755 


.678 


.005 


9 


.692 


.579 


.005 


11 


.640 


.538 


.005 


20 


.675 


.547 


.005 


25 


.622 


.344 


.'025 



Dependence 



1 


.700 


.518 


.005 


15 


.367 


.106 


n.s 


17 


.804 


:661 


.005 


19 


.536 


.407 


.oi- 


23 


.802 


.701 


.005 


27 


.603 


.262 


n.s 



Ps eudo indep endenc e 



2 




.766 


3 




.691 


7 




.767 


8 




.825 


10 




.816 


16 




.919 


18 




.606 


22 




.722 


24 




.563 



.678 


.005 


.659 


.005 


.741 


.005 


.768 


.005 


.735 


.005 


.893 


.005 


.506 


.005 


.575 


.005 


.377 


.01 



a Items for which inter-rater reliability coefficients were .30 or less 
were previously dropped from the checklist. 



^Corrected for spuriousness (to eliminate item T s own contribution to 
total score) . 

c Items marked n.s. had p values of .05 or higher. 
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Table 10 

Mean Z-Scores and Ranks for Independence, Dependence, 
and Pseudoindependence Checklist Categories 

N=40 



,v 




Independence 


Dependence 


Ps eudoindep endenc e <1 


5f 


Subject 
















Code # 


Mean 




Mean 




Mean 




i 


P.S. 90 


Z-Score 


Rank 


Z-Score 


Rank 


Z-Score 


Rank ] 


% 


0000 


0.08 


18 


-0.52 


16 


r 

-1.03 


4 -1 


<r 


937 


0.24 


20 


-0.28 


21 


1.18 


36 1 




939 


1.09 


36 


-1.04 


4 


-1.31 


2 1 




943 


0.67 


30 


-0.56 


15 


-0.81 


7 r i 


£ 


945 


-1.66 


3 


-0.13 


22 


0.31 


29 i 




947 


-1.55 


5 


2.36 


39 . 


0.89 


32 J 




948 


-1.08 


8 


0.72 


31 


0.58 


31 1 




955 


-0.96 


11 


-0.11 


23 


r*.39 


37 ; l 




957 ; 


0.39 


23 


0.24 . 


27 


0.29 


28 


* 


958 | 


-0.02 


16 


-0.72 . 


12 


-0.13 


25 1 


k 


961 


1.03 


35 


-1.22 . 


2 


-1.25 


3 -1 




962 


-1.52 


6 


0.72 


32 


0.24 


27 3 


r 

g ' 


967 


-0.23 


15 


-0.72 


14 


-0.05 


26 ] 


i 


968 


0.75 


31 


-1.05 


3 


-0.99 


5 i 


l 


1004 


-0.96 


10 


0.86 


34 


0.33 


30 i 


i; 

i 


1005 


0.60 • 


28 


0.20 


26 


“0.23 


21 . 1 


§ 


1010 


-0.69 


12 


-0.52 


16 


1.13 


35 1 


r 


1011 


1.24 


38 


-1.43 • 


1 


-1.43 


1 1 


* 


1012 


1.21 


37 


-0.74 


11 


-0.68 


io i 


? 

K 


703 


-1.13 


7 


2.15 


40 


2.61 


A 

39 .1 


V 

?*■ 

k 


932 


0.34 


22 


1.12 


35 


-0.49 


17 3 


i* 

&. 


934 


1.45 


40 


0.66 


29 


-0.55 


14 j 

> 


F «?, 

£> 

p 

f 


P.S. 175 












\ 

-A 

i 


r 

it 


851 


* 1.34 


39 


-0.49 


18 


-0.61 


11 ’ 




852 


0.08 


17 


-0.87 


8 


-0.57 


13 '1 


ft- 

r 

i±V< 


854 


-1.95 


2 


1.38 


37 


2.69 


40 ] 


& 

l 


855 


-0.24 


14 


0.00 


24 


1.01 


34 ] 


£ 


872 


-1.66 


4 


0.75 


33 


2.17 


38 < 


r 


875 


0.56 


26 


-0.76 


10 


-0.55 


315 j 




878 


1.01 


34 


-1.00 


5 


-0.86 


6 { 


r 


879 


-2.09 


1 


2.74 


38 


1.01 


33 ^ 


r; 

5 


881 


-0.35 


13 


-0.72 


13 


-0.18 


22 1 


* 


883 


-0.97 


9 


-0.48 


19 


-0.16 


24 1 




884 


0.78 


32 


-0.91 


7 


-0.69 


9 | 




886 


0.43 


24 


-0.36 


20 


-0.33 


20 •• 


ft 

p 


1003 


0.99 


33 


-0.98 . 


6 


-0.59 


12 


fcs 


1019 


0„32 


21 


-0.79 


9 


-0.38 


19 • 




1020 


0.61 


29 


0.59 


28 


-0.42 


18 i 


jfe 

E 


1021 


0.58 


27 . 


0.05 


25 


-0.79 


s v \ 


i 

L‘ 


1023 


0.11 


19 


1.14 


36 


-0.18 


23 1 


ft, 


1024 


0.46 


25 


0.70 


30 


-0.55 


16 . 1 



f 
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Table 11 



Ranks of Checklist Mean Z-Scores for 
Independence, Dependence, 
and Pseudo independence 3 
N=40 



Subject 
Code No. 


Independence' 


Rank 

Dependence' 


Ps eudo indep endenc e 


934 


1 


12 


27 


851 


2 


23 


30 


1011 


3 


40 


40 


1012 


4 


30 


31 


939 


5 


37 


39 


961 


6 


39 


38 


878 


7 


36 


35 


1003 


i 8 


35 


29 


884 


1 9 


34 


32 


968 


10 


38 


36 


943 


11 


26 


34 


1020 


12 


13 


23 


1005 


13 


15 


20 


1021 


14 


16 


33 


875 


15 • 


31 


26 


1024' 


16 


11 


25 


886 


17 


21 


21 


957 


18 


14 


13 


932 


19 


6 


24 


1019 


20 


32 


22 


937 


21 


20 


5 


1023 


22 


4 


18 


0000 


23 


24 


37 


852 


24 


33 


28 


958 


25 


29 


16 


967 


26 


27 


15 


855 


27 


17 


7 


881 


28 


28 


19 


1010 


29 


25 


6 


955 


30 


18 


4 


1004 


31 


7 


11 


883 


32 


22 


17 


948 


33 


10 


10 


703 


34 


3 


2 


962 


35 


9 


14 


947 


36 


2 


‘ 9 


872 


37 


8 • 


3 


945 


38 


19 


12 


854 


39 


5 


1 


879 


40 


1 


8 



Designation* 

M 
I 
I 
I 
I 
I 
I 
I 
I 
I 
I 
M 
M 
M 
I 
M 
I 
M 
M 
I 
NI 
NI 
M 
M ' 

' NI • 

NI 

NI 

N± 

NI 

NI 

NI 

NI 

NI 

NI 

NI 

NI 

NI 

NI 

NI 

. NI ‘ 



a Subjects are ordered by rank on Independence scale. 

^Designations are: I = Independent; NI = Nonindependent; and M = Mixed 'type. 
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Table 12 



Weighting Matrix for Measuring Disagreement 
between Paired Observers 




* «< 



Independent 

Observer B Highly Moderately 



Independent 

Highly 0 1 

Moderately 1 0 

Pseudoindep endent 

Highly . 4 3 

Moderately 3 2 



Dependent 

Highly 4- .3 

Moderately 3 .2 



Observer A 

*> 

Pseudo independent Dependent 



Highly 


Moderately 


Highly 


Moderately 


4 


3 


4 


3 


3 


•2 


3 


2 


0 


1 


4 


3 


1 


0 


3 


2 


# 

4 


3 


0 


1 


3 


2 


1 


0 
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Table 13 

Distribution of Two Independent Raters r "Global” Ratings 
Based on Summary Checklist Data by Category and Degree 

N=40 



Category Agreements 

Independent 29 



Dependent 1 

Pseudo- 7 

independent 



37 



Breakdown of Agreements Within 
Categories According 





to Degree 




High 

High 


High 

Moderate 


Moderate 

Moderate 


13 


8 


8 


0 


0 


1 


0 


0 


7 



Non-agreements 
or ean r t rate a 3 



Total N 40 ' 



a F 0 r two Ss, the raters disagreed on category; for one S there was a 
can r t rate designation. * ~* 
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1 Observer B 

t 

l Independent . 
> Highly 
| Moderately 



Table 14 

Frequency Distribution of Ratings by Paired 
Observers of Transfer Sessions 3, 



Independent 
Highly Moderately 



0 

6 



Pseudoindependent 
Highly 0 

Moderately 0 



2 

10 



0 

0 



Observer A 
P s eudo ind ep end ent 
Highly Moderately 



0 

0 



0 

0 



0 

0 



0 

0 



Dependent 
Highly Moderately 



1 

1 



0 

1 



1 

2 



0 

0 



Total 



4 

19 



0 

1 



Dependent 

Highly 0 

Moderately 3 



0 

5 



0 

0 



0 

1 



1 

1 



3 

8 



4 

18 



Total 



17 



0 



14 



46 



Includes only those ratings in which the observers expressed high 
or moderate confidence. Total N was 76 (39 experimental Ss and 
37 control Ss) . Ratings in which observers expressed low confi- 
dence (N=24) were excluded, as are those designated ”can r t rate” 
(N=6) . 
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Table 15 



Summary of Agreements and Disagreements Within and Across 
Categories of Ratings in Transfer Sessions 3, 



. Frequency of Agreements 
Within Categories 
Independence' 

Highly- -Highly 0 

Moderately — Moderately 10 

Moderately — Highly 8 

I n 18 

I 

f 

i 



Frequency of Disagreements 

Across Categories 

Pseudo indep endenc e — Indep endence 

Highly pseudo. — Highly inde. 0 

Moderately pseudo. — Highly inde. 0 

Highly pseudo. — Moderately inde. 0 

* 

Moderately pseudo. — Moderately inde. 0 

n 0 






Ps eudolndep endenc e 



f Highly — Highly 0 

■ Moderately — Moderately 0 

r 

\ Moderately— Highly 0 



Independence — Dependence 

Highly inde .- -Highly depend. 1 

Moderately inde. — Moderately depend. 1 

Highly inde. — Moderately depend. 4 

Moderately inde. — Moderately depend. 7 

n • 13 




{; 

l 

l Dependence 

Highly- -Highly 

i Moderately — Moderately 
i • 

l Moderately — Highly 

I * 

h n 



l N 

| a See footnote. Table 14. 

i 




\ t 



-l 

-8 

13 

31 



Pseudoindependence — Pep endence 

Highly pseudo. — Highly depend. 0 

Moderately pseudo. --Highly depend.- 1 

Highly pseudo. — Moderately depend. 0 

Moderately pseudo. — Moderately depend. 1 

n .2 

N 15 
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Table 16 

Checklist Designations: Global Ratings 

vs. Z-Score Classifications 3 

N=29 b 



Global Rating' 



Independent 



Independent- 



13 



Z-Score Classification 

Non- Indep endent 
8 



% 



Dependent 



0 



Pseudoindependent 



0 






k 






Totals 



13 



16 



Data analysis: Chi-square = 8.976; two degrees of freedom; p <.025* 

contingency coefficient =.9-86. N 5 

3 

N of observed Ss in the classrooms * 40. Eliminated from this analysis 
were: 9Ss (see Table 11) whose status was designated m ixed on the basis 
of Z-score profiles (note, one of these Ss was alsoa ”can T t rate” as to 
globally, rated status) ; and 2 Ss who represented disagreements as to 
category between the global checklist raters. 
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Table 17 

Global Checklist Ratings vs. Behavioral Transfer Session Ratings 3 

J^=22 b 



Behavioral Transfer' 
Session Rating 



Indep endent 



Non-Indep endent 



Totals 



Global Checklist Rating 



Independent 



Non- Indep end ent c 



8 



3 * 



11 



0 



19 



3 



a 

Data analysis: Chi-square=l .544- ; 0 ne degree of freedom; £ value is non- 

significant; phi coefficient =.27 • Chi-.square value is Yates-corrected, 
b 

N of observed Ss in the classrooms = 40; one _S was absent from the transfer 
session so that all analyses for experimental Ss in the transfer sessions 
are based on an N of 39. Of these Ss, for purposes of the above analysis, 
the following Ss were eliminated: 14 Ss representing disagreements between 

raters in the behavioral sessions, and the three £5s representing disagree- 
ments or Tr can T t rate" of the global raters of the checklist (interestingly, 
2 of these 3 Ss also represented disagreements between raters in the 
transfer sessions) . 
c 

This category represents a "collapsed" category of Dependent and Pseudoin- 
dependent global ratings. 
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Table 18 

Z-Score Checklist Designations vs. Ratings in 
the Transfer Situation^ 



N=18 



Ratings in Transfer 
Sessions 



Z-Scpre Checklist Designation 
Independent ‘ Non-Independent 



Indep endent 



Dependent 



Pseudoindep endent 



0 



Totals 



11 



Data analysis: Chi-square — 1.168; two degrees of freedom; p value is 

nonsignificant; contingency coefficient = .247. 

N of observed Ss in the classroom = 40; one S was absent from the transfer 
session so that all analyses for experimental Ss in the transfer sessions 
are based on an N of 39. Of these Ss, for purposes of the above analysis, 
the following Ss were eliminated: 9 Ss for whom the Checklist Z-score 

designations were "mixed” (four of these were also disagreements between 
the raters in the behavioral sessions) ; and 12 Ss representing disagree- 
ments between raters in the behavioral sessions. 



r 



O 

ERIC 



-72- 



Table 19 

Frequency Distributions of Global Checklist Ratings, Z-Score 
Checklist Designations, and Behavioral Sessions Ratings 
(Experimental Subjects Only) by Length of Exposure 
to Institute Program ("Filler Status") 



Subject Classification 

( 1 ) 

Global Checklist Rating 
Independent 



N 



37 



Dependent 
Ps eudoindep endent 
( 2 ) 

Z-Score Checklist Designation 31 
Independent 
Non- Independent 
( 3 ) 

Behavioral Session Rating 23 
Independent 
Dependent 
Ps eudo indep end ent 



Length of Exposure to Institute Program* 



11 

0 

4 



4 

10 



3 

4 
0 



FK 



1 

0 

1 



1 

1 



0 

1 

0 



FI 



7 

0 

1 



4 

4 



4 

2 

0 



F2 



1 

X 



0 



1 

1 



1 

1 

0 



F3 



8 

0 

1 



3 

2 



4 

2 

1 



See Footnote. (a) Table 20 for explanation of these Ns. 

Groups designated as E entered the program at the pre-kindero-arten level 
in September, 1964. 

Groups designated as FK entered the program at the kindergarten level 
in September, 1965. 

Groups designated as FI entered the program at the first °- ra de level 
in September, 1966. ° 

Groups designated as F2 entered the program at the second crrade level 
in September, 1967 

Groups designated as F3 entered the program at the third orade level 
in September, 1968. 
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Table 20 



Checklist and Transfer Session Ratings of Experimental 
Subjects and Length of Exposure to the Institute T s 
Program ("Filler" Status) 



( 1 ) 




( 2 ) 




31 



Comparison Groups 1 



Chi-Square 

Value 



Degrees 

of _ £ 

Freedom value 



.Global Checklist .872 

Ratings X F3 
Ss vs. all others 
(3x2 table) 



Z-score Checklist .799 C l 

Designations X 
F3 Ss vs. all 
others (2x2 table) 



( 3 ) 23 Behavioral (Transfer) 2.847 2 

Session Ratings X F3 Ss 
vs. all others (3x2 
table) 



N-40 (classroom observations). F 0 r comparison (1), N=37, since 3 Ss 
represented disagreements or can T t rate in re: the global ratings. 

For comparison (2) , N=31 since there were 9 "mixed" Z-score classi- 
fications. For comparison (3) N = 23, since there were 39 experimental. 

Ss in the transfer session and 16 represented disagreements between 
the raters . 
b 

See Table 19 for explanations of "filler" status. For example, F3 
refers to all experimental subjects who entered the Institute’s 
program in 1968. 
c 

Yates-corrected (2x2 table) . 
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Table 21 



Chi-Square Conparisons of Ratings of Behavioral Sessions: 

Experimental vs. Control Subjects for Both. Schools 

a 

Combined and for Schools Held Separately 



Comparison 

CD 

With "low confidence" 
ratings included 



N 



( 2 ) 

With "low confidence" 
ratings excluded 
(even if one rater 
used this category) 



N 



0 ) 



Both Schools Combined 

1 

Rating Exper. Control N 



Indep . 
Depend. 



8 



15 



13 

6 

19 34- 



Indep . 
Depend. 



4- 

6 

10 



9 

6 

15 



Public School 175 
(With "low confidence" 
ratings included) 



• Indep . 
Depend. 



25 



Chi-Square 



.863 



£ 

value 



ns 



.327 



ns 



059 



ns 



N 



8 



15 



(4) 



N 



Public School 90 
(With "low confidence" 
ratings included) 



Indep . 
Depend. 



4 

4- 

8 



8 

3 

11 



19 



.283 



ns 



All conparisons are based on four-fold tables (one degree of freedom) with 
chi-square values that are Yates-corrected. The experimental group contains 
only those Ss who have had one or more years of exposure to the Institute program. 



o 

ERIC 



See text, Part B, end of Chapter 3, for explanation of these Ns. 



Solution for Design (A) — Task (2) 




Figure 2 
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Geometric Design (B) for Task (2) 
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Figure 3 
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Solution for Design (B) — Task (2) 




Figure 4 
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CODE • • 



OBSERVER 



Appendix A 

.The Classroom Behavior Checklist 
. SEX ' ‘ ' DATE 

TIME STARTED 



OBSERVATION NUMBER 

SCHOOL TEACHER 



p 

ft 

O G 



0 



>* 


>. 


P 




H 




ft 




P 

G 


0 

P 


O 




0 


ctf 


>> 




2. 


U 


H 




& 


0 


0 


0 


0 




U 


> 


G 


O 


Ctf 


0 


ft 


S 


ft 


53 



(1) 

( 2 ) 

(3) 

GO 

( 5 ) 



( 6 ) 

(7) 

( 8 ) 



(9) 

( 10 ) 

( 11 ) 



( 12 ) 

(13) 

r ' . ( 1*0 

i (15) 

(16) 

; • (i7) 

I ' (18) 

\ (19) 

| ( 20 ) 

\} 

k* 

t 



withdraws in the face of difficulty 

is inattentive; is easily distracted by 

things going on around him 

uses materials and equipment in a rough or 

destructive manner 

volunteers contributions to class discussions 
and projects 

helps, sympathizes, shows consideration of 
others; is thoughtful; offers praise, 
guidance, assurance 

sits quietly and attentively when task 
requires 

brags, shows* off , displays exaggerated opinion 
of own abilities 

seeks attention, i.e., in a manner that seems 
designed for active notice rather than 
stemming from a need for help 
utilizes available free time constructively 
interferes with the work of others 
withstands interference while engaged in 
individual activities, e.g. , doing difficult 
assignment, a puzzle, painting 
imitates others rather than initiating own 
activities 

gets upset when called upon in class; appears 
fearful, tense, timid 

takes appropriate initiative in problem- 
solving situations 
seeks to be near others 
does not fo3.1ow directions 
requires close assistance or direction in 
order to work at a task 

seeks to do things differently from others, 
even when own method is not effective 
lets other children impose on him or boss 
him around 

tries to figure out things for himself 
before calling on teacher (leader) or 
other children for help 



0 
p 
o cd 
P ft 

>>P 
P *• 
•H £ 
G cti 

3 o 



p 

G •« 
O 0 

ft > 
ft g 

O 0 
to 
o 

2 O 



X 




r 
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V 4 

' * 

' (21) enters readily into new situations; is 

venturesome, inquisitive, etc., when 
• appropriate to ongoing activities 

(22) does not pursue task to completion 

(23) seeks constant recognition and/or 

! approval 

(24) speaks out of turn; interrupts others; 
takes other’s turn, etc. 

(25) attempts to resolve difficulties that 
arise between himself and ether 

j children without appealing to teacher 

j (leader) 

f (26) approaches new tasks timidly and ivithout 

| confidence; shrinks from trying new 

: things 

j (27) tends to choose habitual and familiar 

I activities 

{ 



i 



t 

f 



i 

| 




Appendix B 

The Revised Classroom Behavior Checklist 



(1) withdraws in the face of difficulty 

(2) is inattentive; is easily distracted 
by things going on around him 

(3) uses materials and equipment in a rough 
or destructive manner 

(M-) helps,' sympathizes, shows consideration 
of others; is thoughtful; offers praise, 
guidance, assurance 

(5) sits quietly and attentively when task 
requires 

(6) brags, shows off, displays exaggerated 
opinion of own abilities 

(7) seeks attention, i.e. , in a manner that 
seems designed for active notice rather 
than stemming from a need for help 

(8) utilizes available free time construc- 
tively 

(9) interferes with the work of others 

(10) withstands interference while engaged 
in individual activities, e.g., doing 
difficult assignment, a puzzle, painting 

(11) does not follow directions 

(12) requires close assistance or direction 
in order to work at a task 

(13) seeks to do things differently from 
others, even when own method is not 
effective 

(14-) lets other children impose on him or 
boss him around 

(15) tries to figure out things for himself 
before calling on teacher (leader) or 
other chi.ldren for help 

(16) does not pursue task to completion 

(17) seeks constant recognition and/or 
approval 

(18) speaks out of turn; interrupts others; 
takes other r s turn, etc. 

(19) attempts to resolve difficulties that 
arise between himself and other children 
without appealing to teacher (leader) 



